M

Tuesday, September 14th, 2021 7:50 PM

Is Azure data factory and the pipelines run via Azure Synapse( integrated data factory ) supported in Collibra ?

Is Azure Data factory and the pipelines run via Azure Synapse( integrated data factory ) supported in Collibra ?

I want to see the transformation logic which exists in the Azure pipelines ( via ADF and Synapse ) .

If this is not possible at the moment , will this be done in the coming future ?

262 Messages

3 years ago

Check the lineage harvester documentation for up to date supported sources.

I did this few weeks ago for requirements in my project. I could not find ADF in supported sources.

50 Messages

Thanks , I did check here -https://productresources.collibra.com/docs/collibra/latest/Content/CollibraDataLineage/TechnicalLineage/ref_technical-lineage-supported-data-sources.htm

It seems Cloud ETL pipeline technologies are not supported at all. Collibra only seems to support commonly used on premise ETL solutions. I hope Collibra Product team has some firm answers

Its a tedious job to build manual mappings and maintain them .Also most of the ETL has python scripts running .

Not sure where we can find the road map of Collibra on CLOUD Pipelines.

Note: Apache Airflows are not supported as well.

Loading...