Functional: DQ Capabilities

Please use this INTERNAL discussion thread to ask any functional questions about the Data Quality (DQ) Capabilities. Below are some frequently asked questions and resources to get you started.

Top Links

Workflows

Q: Does Collibra DQ provide workflows?
A: Yes, Collibra DQ has built-in assignment queue and alerts if quality drops below a threshold.

We are working with PS to bundle / offer a DQ workflows package in marketplace in September to facilitate DQ use cases. Please note, this will not be bi-directional DQ<>DGC<>DQ to start with i.e. these are only within DGC.

Logging / Monitoring

Q: Does Collibra DQ Provide Front-End Data Entry Monitoring That Also Recommends Appropriate Data Entry To Salesforce For Example?
A: No, We Do Not Currently Support Front-End Data Monitoring. We Could Scan Against Salesforce, But That Would Be After Entry

Q: Can Services And Applications Be Monitored By Apps Such As Nagios?
A: Yes

Q: Is There A Logs Page?
A: Yes, We Expose Logs On Jobs Page. Users Typically Spend More Time On Jobs Page

Q: Can Logs Be Centralized In Dedicated Server?
A: Yes, Logs Can Be Redirected To Any Location

Alerts

Q: How Do I Get Alerts / Notified Of Issues? (A: Collibra DQ currently offers e-mail alerts based on thresholds or events; we will want to leverage and promote Collibra’s workflows shortly.

Q: Do You Provide Notifications In Case Of Updates From User In Data Model?
A: Data Model Updates Are Handled By Flyway

Dashboard / Reports

Q: View By Attribute, Value And Count?
A: Custom Reports Accessible By Metastore, Need Custom SQL For Beyond TopN

Q: How Customizable Is Dashboard? Are There Widgets?
A: You Will Have Access To Metastore For Custom Reports

Q: Do You Have Capability For Dashboarding And KPI Tracking?
A: Yes, And We Will Further Develop As Part Of Integration Process With Broader Collibra Platform

Q: Can the frequency of the Pulse view be changed to every minute (or different frequencies?)
A: Currently, Only Days / Months

Replay / Behavior

Q: Behavior Lookback, Related To # Of Samples?
A: Yes, # Days Selected Forms Baseline

Q: How Is Replay Different From Behavioral Lookback?
A: Replay Looks At Gathering Actual 10 Days; Behavioral Lookback Function Looks To Adjust Baseline Profile

Cleansing, Remediation, Standardization

Q: Does Collibra DQ perform cleansing?
A: Collibra’s principle is to not change the source data directly but provide the complete context to the data issues as well as provide workflows that enable efficient resolution of the data issues. This holistic approach means users can easily identify and focus on highest-impact issues.

Collibra Data Quality (CDQ) facilitates comprehensive remediation by providing the exception records based on insights that our competition would not capture via manual rule creation and management or incomplete data source coverage. With regards to time-series anomalies, our baseline profiles and adaptive rules continuously monitor and learn from data over time and will alert the dataset owners on data defects.

With regards to integration with remediation tools, our CDQ solution working with the Collibra Data Governance solution can notify the right data owners of errors or abnormalities and offer detail about those errors so the individual can better remediate the issue. Our customers do not just focus on just fixing the records, but remediate the root cause as part of their ETL process. Collibra’s OOTB asset types (eg. Data Quality Rule, Data Quality Metric) and APIs also allow for easy integration with any external DQ tools (eg Address Doctor). We also have pre-built integrations with common DQ tools such as IDQ, Precisely, Ataccama.