Data Quality Metrics - without CDQ
Summary: William O'Shea, also known as William O'Shea, has started using Collibra for data quality (DQ) management and wants to report on DQ results collected from tools like Databricks and IBM CP4D. They have defined several data quality rules and are now looking to capture associated metrics over time. William is seeking advice on how to load these metrics on a daily basis, track progress, and determine the appropriate asset type for metric loading. They are experiencing issues with messages such as "No data quality monitors yet" and "something went wrong" when attempting to view data. William requests help and advice to overcome these challenges.
Hello all
we have just started using Collibra and want to be able to report on DQ results (Metrics) that we gather in various other DQ tools, such as Databricks and IBM CP4D.
we have defined several data Quality Rules, but now want to start capturing the metrics associated with each of these over time.
I see in the rule I can put rows loaded and passing fraction, but this is only once.
how do I load them in on a daily basis, so that we can track progress.
What Asset Type should I use to load the metrics into?
how do I get to see them
right now I get the errors:
No data quality monitors yet. (when viewing from the rule)
something went wrong (when viewing from a data product)
any help or advice would be greatly appreciated please?
Will
William O'Shea
OP6 months agoto be more precise, this is the second error that I get:
Something went wrong
Invalid time value