Collibra Community logo
  • Community Resources
    • Discussions
    • FAQ
    • Take a tour
    • Request a demo
    • Community job board
    • Resources
  • Participate
    • Discussions
    • Ideation
  • Learn
    • Customer stories
    • Marketplace
    • Blogs
    • University
    • Video tutorials
    • Knowledge Base
    • Developer Portal
    • Podcast “Data Citizens Dialogues”
    • Collibra Excellence Awards
  • Support
    • Support Portal
    • Documentation
    • Release notes
    • Product resource center
  • User Groups and Events
    • Events
    • Collibra Customer Events
    • Data Citizens® User Groups
  •      
  •          
Discussions
  •                    
  •                    
  •                    
  •                    
  •                    
  •                    
  •                    
  •                    
  •                    
  •                    
  •                    
  •                    
  •                    
  •                    
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               
Discussions
Collibra Logo Community
  • About Collibra
  • Collibra Data Intelligence Platform
  • Blog
  • Careers
  • Partner Program
  • Contact us
© 2025 Collibra. All rights reserved.
  • Privacy and legal
  • Do not sell or share my personal information
© 2025 Collibra. All rights reserved.
  • ForumsChevronRightIcon
  • ProductChevronRightIcon
Data Quality & Observability

Created Nov 18, 2023

39 members

227 discussions

The Data Quality & Observability section of the Collibra Community is focused on ensuring trust in data through quality monitoring and observability practices. It’s where users explore tools, workflows, and strategies to assess, track, and improve the health and reliability of their data assets across the enterprise.

Data Quality & Observability
                   
                                       
  •                                        
  •                                        
  •                                        
  •                                        
  • matthewtaylor

    matthewtaylor

    9 days ago
    Data quality aggregation paths

    Hi, we do not have the data quality and observability feature, but we do have data quality metrics catalogued in the Data Quality Metric asset type. This asset type is related to Data Quality Rule which is related to Column. I created an custom aggregation path from column to metrics to display the data quality metrics against a given column, but no results are returned in the Column asset. Instead I get the message " No data quality monitors yet." Any ideas why this might be happening? All suggestions gratefully received.

                                           
    0
             
  • Lance Harlan

    Lance Harlan

    15 days ago
    Job termination

    Hi everyone, I'm trying to troubleshoot why my agent isn't starting in my environment. I get two messages, the first is "[main] ERROR com.owl.agent.bootstrap.AgentBootstrap - Error during agentConfiguration and startup: Failed to obtain JDBC Connection org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection." I'm not sure what connection it's looking for other than the connection to my client database, which I do see and can search through it in the console. The other says it has "too many clients already." I don't know what that means, but I do see the agent has 11 open jobs and I can't terminate any of them, I just get an error message, but the error isn't telling me why. I've been hunting through the API's for clearing jobs, but I'm not seeing anything there either. How can I clear all of these jobs to see if my agent will start? Has anyone had a similar situation? If so, how did you fix it?

                                           
    1
             
  • Joseph Patton

    Joseph Patton

    1 month ago
    Best Practices for MetaStore Data Retention

    Hello All, I was assigned to platform support of my company's Collibra DQ environments about 6 months ago. So far, so good, but I believe that we might have some minor issues related to the metastore component( external postgres flexible server, "cloud native" Azure Kubernetes agent/web/livy/spark config). The largest objects in the database by far are the following: data_preview rule_breaks validate_source_value assignment_q_audit assignment_q observation We are currently on version 2025.04-ABDGCSHILM-4254. These environments were stood up several years ago by engineers who are no longer at our company. I'm still moving up the learning curve with this platform, but I don't believe that anything was configured beyond defaults for data retention. I recently set the Data Retention Policy to "By Time / By Run Date(run_id) / 120 Days." I just wanted to get some feedback on metastore best practices and determine whether there is any "bloat" in our metastore databases that require attention. This might not be a major issue, but I have observed a query against the rule_breaks table(with no WHERE clause) that has run 19 times over the past 28 days with an execution times ranging between 1.5 minutes and 43 minutes. I have also noticed a query against the rule_breaks table that has executed 20 times in the last 28 days with exec times ranging between 8 and 25 minutes: --rule breaks long running sql -- SELECT "public"."rule_breaks"."dataset",        "public"."rule_breaks"."run_id",        "public"."rule_breaks"."rule_nm",        "public"."rule_breaks"."link_id" FROM   "public"."rule_breaks"  -- validate source id long running sql -- select id, CAST(uuid AS VARCHAR(255)) UUID , validate_source_id, cast(validate_source_uuid AS VARCHAR(255)) as validate_source_uuid, assignment_id, cast(assignment_uuid AS VARCHAR(255)) as assignment_uuid , obs_sub_type , key_col_nm , key_col_value, target_link_id, source_link_id, target_col_nm, target_col_value, source_col_nm, source_col_value, confidence , cnt from public.validate_source_value

                                           
    1
             
  • danieljdavis

    danieljdavis

    2 months ago
    Rename a connection in place?

    Data Quality version: 2025.01-ABDGCSHILM-4246 (I tried searching through these forums, but there doesn't seem to be an obvious way to do that either.) Is there no way to rename a connection in place? (Or, I should say, actually rename a connection?) Using the rename action from the dropdown just creates a new connection with the new name and doesn't bring over any existing datasets.

                                           
    1
             
  • Grant Rollerson

    Grant Rollerson

    2 months ago
    DQO Classic - Fastlink to Break Records

    Does anyone have the same issue a DQ Job with a Custom Rule which breaks every day, because of the same record(s) ... which is a known false positive the DQ Analyst daily receives an email generated by an Alert, goes into DQO dataset (DQ Job) and confirm the break is the one they see daily and not a real break ... so there's no real issue but it's a pain in the neck and a waste of his/her time So Get the rule changed to explicitly exclude that record from the test, which is pretty hacky OR is there any other way to solve this issue in a more programmatic way? either have the Custom Rule "learn" to accept that record or include the actual Break Records in the email, or post a fast link to same Nothing definitive in Ideation but I see; Possibility to Add Customizable Columns for DQ | Ideation platform Brad Fuchs 31 Mar, 2025 We are working to make the break record experience more cohesive. Please keep an eye on upcoming releases as changes will start to roll out.

                                           
    1
             
  • Dan Everett

    Dan Everett

    2 months ago
    Collibra Data Quality and Observability 2025.05

    Yesterday Collibra Data Quality & Observability 2025.05 was released. Release notes are here. https://productresources.collibra.com/docs/collibra/latest/Content/DataQuality/release-notes.htm

                                           
    1
             
  • danestep

    danestep

    3 months ago
    DG to DQ Valid Values Rule Updates

    Is there any way to take advantage of DG Code sets within CDQ Custom Rules? I am wanting the steward work within the catalog and affiliated code sets to become the updated input into a data class / data quality rule. The desired outcome is that the definition of valid values can be owned by the catalog steward, and as they are updated, the job has maintenance applied by accepting updates or referring back to the current catalog resources. Today we're hardcoding the rules and would be updating in a very manual notification way. Thank and Regards, Dan

                                           
    3
             
  • emiliawalencik1

    emiliawalencik1

    3 months ago
    Asset Quality Page
                             

    Hello there, Can anyone guide me on how to set up the aggregation path and relations to view different charts representing various quality dimensions? I'm failing to do so, I have no idea where I'm making a mistake. This is the quality tab view I currently see: This is the aggregation path I created: This is a traceability diagram:

    Discussion thumbnail
                                           
    1
             
  • sudhirnune

    sudhirnune

    3 months ago
    SAP S4 - ECC Connectivity to Collibra DQ View HANA and Performances Impact

    We are planning to connect to SAP S4 ECC over HANA backend for running Data Quality rules. We would like to understand if we have implemented this connectivity to S4 HANA Backend of ECC applications. If yes need help with Did you choose Pull Up / Push Down Do you see any issue with the performance of the S4 been impacted Any sizing / performance bench marks created

                                           
    0
             
  • hyoosaf

    hyoosaf

    4 months ago
    Postgres metastore tables where the metabar details of Collibra DQ dataset findings page are stored
                             

    Hello there, Can anyone help me understand from which Postgres metastore tables the metabar details of Collibra DQ dataset findings page are fetched - Screenshot attached. To be more specific, would like to know where the below are stored : 1.column count 2.Source details 3.Data Category Thanks, Hazeena

    Discussion thumbnail
                                           
    4
             
…