E

4 Messages

 • 

605 Points

Friday, October 18th, 2024 3:41 PM

Data Quality is not being monitored

Hi Everyone,

I’ve been trying to set up a Data Quality Tab in the Asset Page in Collibra Physical Data Dictionary, but despite going through hundreds of pages of Collibra documentation and training materials on Collibra University, I still haven’t been able to get it right. The Quality tab isn’t returning any results, and I’m getting a message that “Data Quality is not being monitored".

I’m also confused about the difference between Data Asset Quality (with rules and metrics set in Collibra) and the Data Quality and Observability product (with its own set of rules and metrics). Could someone here please explain the difference?

If anyone has any good guidelines or could share a universal, simplest setup example that I could test to get the Quality tab working, that would be fantastic.

87 Messages

 • 

3.1K Points

2 months ago

For the Quality tab to function you might need to reach out to support to have them flag your instance to allow customizations. Once that is done you would need to confirm that:

  1. You have a relationship from the asset to the metric (I.e. Asset complies to Data Governance asset for Column to DQ Metric)
  2. That your data quality rule is setup with the same relationship (Asset complies to Data Governance asset)
  3. For the Column asset type that Data Quality Rule is set

Keeping in mind when mentioning Data Quality Rules that means the configuration, and not the asset type. We do not use the DQ product, and so I would not be able to comment on that configuration.

144 Messages

 • 

9.9K Points

it hasn't been working lately, they have fixed it in 2024.10 (although we have a few support tickets still), if you are receiving DQ metrics from Collibra DQ you can use the Data quality rule functionality to do aggregated path reporting. 

  • About data quality rules (collibra.com)
  • Release Notes (collibra.com)
    • Integration

        • You can now define custom integration data quality rules, which are also known as aggregation paths, in the Collibra Data Intelligence Platform operating model setting to allow you to view data quality scores for assets other than databases, schemas, tables, and columns.

      Important You need a minimum of Collibra Data Intelligence Platform 2024.10 and Collibra Data Quality & Observability 2024.07.

      • Users of the Quality tab in Collibra Data Intelligence Platform who do not have a Collibra Data Quality & Observability account can now view the history table to track the evolution of the quality score of a given asset.
      • When using Replay to run DQ Jobs over a defined historical period, for example 5 days in the past, the metrics from each backrun DQ Job is included in the DQ History table and the quality calculation.
      • After integrating a dataset from Collibra Data Quality & Observability and Collibra Data Intelligence Platform, you can now see the number of passing and failing rows for a given rule on the Data Quality Rule asset page.
      • The JSON of a dataset integration between Collibra Data Quality & Observability and Collibra Data Intelligence Platform now shows the number of passing and breaking records.
Loading...