Error when running Collibra Lineage Harvester

@RajeshK If you haven’t already, this would be a good candidate for submission to our Support Portal. When submitting, I would reference the URL of this thread.

@spring-team.collibra.com can you have a look please?

Hi @RajeshK,

Thanks for trying the Collibra Integration Library.

Regarding the error encountered, can you please try using the following annotation?

@SpringBootApplication(scanBasePackages = { "com.collibra" })

Hi @RajeshK,

Thanks for the update.

The CollibraPredefinedTechnicalLineage is just a POJO that contains builder methods. It is the root class that is used to define the lineage that would be written in JSON format and sent to the Collibra Lineage Harvester for processing. Example:

CollibraPredefinedTechnicalLineage.Builder lineageRequestBuilder = 
     new CollibraPredefinedTechnicalLineage.Builder()
			.addVersion("1.0")
			.addTree(...)
			.addLineages(...);

The CollibraTechnicalLineageHelper class should be autowired and the the following methods can be called (only one from the last two):

• public void writeLineageFile (String lineageSourcePath, CollibraPredefinedTechnicalLineage predefinedTechnicalLineage);
• public int triggerLineageHarvesterFullSync (String lineageSourceId);
• public LineageHarvesterResult triggerLineageHarvesterFullSyncDetailed (final String lineageSourceId);

where:

• writeLineageFile method is used to write the CollibraPredefinedTechnicalLineage data in JSON format;
• triggerLineageHarvesterFullSync is used to trigger the full sync, returning the exit code;
• triggerLineageHarvesterFullSyncDetailed is used to trigger the full sync, returning some information in addition to the exit code.

Also, by any chance did you try replicating what is being done in the GCP Dataflow to Collibra integration as explained here please? Thanks