2 Messages
Harvest lineage from SQL files
Hi,
I have a few local MSSQL & ORACLE DBs that can not be linked to Collibra’s Tech lineage harvester. However I have rights to run any kind of queries on these DBs.
I want to harvest tech lineage from these local DBs and was wondering if there is a method to do that (may be by SQL Files).
Collibra product documentation does mention this use case, but this resource hardly helps.
Has anyone implented this custom lineage via SQL and can they share the process to do the same ?
Thanks.
nupurpansari1
14 Messages
2 years ago
Hi @nikhil.dayal.aemo.com.au,
Were you able to implement the custom lineage via SQL?
I have the same requirement with my client where for one particular table I need to refer to the SQL files which contains the create and the insert statements for the same.
Could you please share the process?
Thanks in advance,
Nupur
0
0
gnanasekaranmp
4 Messages
2 years ago
Hi Guys,
I have the same requirment as well, How do we harvest the lineage from a SQL file, Steps/process Please ?
2
0
integrationdev_rohit
35 Messages
2 years ago
Hi ,
Please refer to the document it is detailed and clear steps . I have done this recently and got the results.
Step1 : Installation of LH : https://productresources.collibra.com/docs/collibra/latest/Content/CollibraDataLineage/TechnicalLineage/InstallationAndConfiguration/LineageHarvestingApp/ref_lineage-harvester-requirements.htm
Step2 : Add the sql file in the correct location
link : https://productresources.collibra.com/docs/collibra/latest/Content/CollibraDataLineage/TechnicalLineage/InstallationAndConfiguration/ta_prepare-sql-directory.htm
Step3 : Prepare your configuration file.
https://productresources.collibra.com/docs/collibra/latest/Content/CollibraDataLineage/TechnicalLineage/InstallationAndConfiguration/LineageHarvestingApp/co_configuration-file.htm#tab-1
Step4 : Run the LH command to extract the lineage.
https://productresources.collibra.com/docs/collibra/latest/Content/CollibraDataLineage/TechnicalLineage/ta_run_lineage_harvester.htm
You can follow these steps and in case of any issue reach out to collibra team also they will be of great help.
Also please check if any proxy or firewall is in place so needful minor change will be required but you can start from here.
Regards,
Rohit
2
0