Data Quality Integration - Columns not linked
The Collibra Data Quality integration only builds relationships to Tables - ‘Data Quality Rule governs Table’, even though the column is listed in the DQ Rule path. This means you cannot view DQ metrics at the Column level.
As a result - I have had to build the below manual process for my client:
- Export Rule data from DGC
- Paste into Excel
- Run Power Query to convert relationships to Columns
- Import s/s to DGC
** Tag Tables and Columns with ‘DQ’ Tag
** The final step is done so that I can create a view /diagram filter which shows all Columns in a DB which have a DQ score (see screenshot)
*Please fix this - the data ingested from Collibra DQ should be related to the Column/not table
Graham Pearman
Posted 4 years ago · Edited 1 year ago·Last reply 4 years ago
4 comments
Bineesh Babu
·4 years ago · EditedHello @graham.pearman,
CDQ integration do bring the column lineage as well . You need to make sure while creating the rule you select the columns in CDQ. For now you can only select one column here
Once above step is done , you need to go to Data Quality Rule assignment in DGC and below relation " governs Data Element"
This will bring the Column relation to Data Quality Rules as shown below
Bineesh Babu
·4 years ago · EditedHello @graham.pearman,
CDQ integration do bring the column lineage as well . You need to make sure while creating the rule you select the columns in CDQ. For now you can only select one column here
Once above step is done , you need to go to Data Quality Rule assignment in DGC and below relation " governs Data Element"
This will bring the Column relation to Data Quality Rules as shown below
Graham Pearman
OP4 years ago · EditedThanks Bineesh. This is useful.
Re: displaying DQ asset information based on filters - I will raise this as a separate post.
Alexandra Jorgenson
Admin4 years ago · Edited@graham.pearman FYI, I moved this and your other DQ post from today to our DQ-specific forum.