SSIS transformation lineage and limitations in viewing in lineage
- Are Control flow tasks in SSIS supported? There is no documentation on Collibra saying support or no support for Control flow tasks
2.Has Collibra created any documentation showing how a SSIS package looks like in Collibra using a simple SSIS package for demonstration and understanding ?
Note not this : https://productresources.collibra.com/docs/cloud-user/latest/#CollibraDataLineage/TechnicalLineage/ref_supported-transformations.htm#ssis
If anyone has implemented SSIS in Collibra , can you share your experiences ?
mudassara
Posted 4 years ago · Edited 2 years ago·Last reply 4 years ago
6 comments
mudassara
OP4 years ago · EditedMany thanks Kristen for answering this thread .
I highly appreciate your help .
mudassara
OP4 years ago · EditedThanks for the answering the first question . How about answer to the second question?
2.Has Collibra created any documentation showing how a SSIS package looks like in Collibra using a simple SSIS package for demonstration and understanding ?
Alexandra Jorgenson
Admin4 years ago · Edited@mudassar.abdul.teck.com, I spoke with a Data Catalog Product Manager and she had this to say “I don’t think there is other customer facing documentation than instructions on how to create the configuration file and how to export the SSIS package.” You can however request a demo (ask your CSM - believe that is @manan.joshi.collibra.com?). She also added this “I’m confused about the ‘how an SSIS package looks like in Collibra’. The package itself is only visible in the technical lineage. Because it’s an ETL tool, you cannot ingest data directly from SSIS into Collibra. You can however ingest data sources within SSIS in Catalog and create a technical lineage for SSIS. The result will be that the data sources will automatically be stitched using the relation type ‘Data Element sources/targets Data Element’ on the Column level. In the technical lineage, you will see how the data flows.” I hope this helps.
mudassara
OP4 years ago · EditedThanks for the answering the first question . How about answer to the second question?
2.Has Collibra created any documentation showing how a SSIS package looks like in Collibra using a simple SSIS package for demonstration and understanding ?
Alexandra Jorgenson
Admin4 years ago · Edited@mudassar.abdul.teck.com, Sales Engineering shared this screenshot that shows an SSIS package displayed in the Technical Lineage view in Collibra. This might help.
Alexandra Jorgenson
Admin4 years ago · Edited@radim.dejmek.collibra.com, a developer on our lineage team, provided this response @mudassar.abdul.teck.com: "As far as I know - control flow task usually itself does not bear any lineage/dataflow information ( control flow defines execution order…) so control flow itself is not leveraged / processed. ( Only childs/steps of this control flows are analyzed… )
Example:
When you have SSIS Foreach Loop container that contains any child that is important for data lineage ( it could be SQL Task, or Data Flow… etc ) - these items/childs are properly discovered and analyzed …"
I hope this helps.