Collibra Community logo
  • Community Resources
    • Discussions
    • FAQ
    • Take a tour
    • Request a demo
    • Community job board
    • Resources
  • Participate
    • Discussions
    • Ideation
  • Learn
    • Customer stories
    • Marketplace
    • Blogs
    • University
    • Video tutorials
    • Knowledge Base
    • Developer Portal
    • Podcast “Data Citizens Dialogues”
    • Collibra Excellence Awards
  • Support
    • Support Portal
    • Documentation
    • Release notes
    • Product resource center
  • User Groups and Events
    • Events
    • Collibra Customer Events
    • Data Citizens® User Groups
  •      
  •          
Discussions
  •                    
  •                    
  •                    
  •                    
  •                    
  •                    
  •                    
  •                    
  •                    
  •                    
  •                    
  •                    
  •                    
  •                    
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               
Discussions
Collibra Logo Community
  • About Collibra
  • Collibra Data Intelligence Platform
  • Blog
  • Careers
  • Partner Program
  • Contact us
© 2025 Collibra. All rights reserved.
  • Privacy and legal
  • Do not sell or share my personal information
© 2025 Collibra. All rights reserved.
  • ForumsChevronRightIcon
  • ProductChevronRightIcon
Data Quality & Observability

Created Nov 18, 2023

30 members

225 discussions

The Data Quality & Observability section of the Collibra Community is focused on ensuring trust in data through quality monitoring and observability practices. It’s where users explore tools, workflows, and strategies to assess, track, and improve the health and reliability of their data assets across the enterprise.

Data Quality & Observability
                   
                                       
  •                                        
  •                                        
  •                                        
  •                                        
  • Joseph Patton

    Joseph Patton

    13 hours ago
    Best Practices for MetaStore Data Retention

    Hello All, I was assigned to platform support of my company's Collibra DQ environments about 6 months ago. So far, so good, but I believe that we might have some minor issues related to the metastore component( external postgres flexible server, "cloud native" Azure Kubernetes agent/web/livy/spark config). The largest objects in the database by far are the following: data_preview rule_breaks validate_source_value assignment_q_audit assignment_q observation We are currently on version 2025.04-ABDGCSHILM-4254. These environments were stood up several years ago by engineers who are no longer at our company. I'm still moving up the learning curve with this platform, but I don't believe that anything was configured beyond defaults for data retention. I recently set the Data Retention Policy to "By Time / By Run Date(run_id) / 120 Days." I just wanted to get some feedback on metastore best practices and determine whether there is any "bloat" in our metastore databases that require attention. This might not be a major issue, but I have observed a query against the rule_breaks table(with no WHERE clause) that has run 19 times over the past 28 days with an execution times ranging between 1.5 minutes and 43 minutes. I have also noticed a query against the rule_breaks table that has executed 20 times in the last 28 days with exec times ranging between 8 and 25 minutes: --rule breaks long running sql -- SELECT "public"."rule_breaks"."dataset",        "public"."rule_breaks"."run_id",        "public"."rule_breaks"."rule_nm",        "public"."rule_breaks"."link_id" FROM   "public"."rule_breaks"  -- validate source id long running sql -- select id, CAST(uuid AS VARCHAR(255)) UUID , validate_source_id, cast(validate_source_uuid AS VARCHAR(255)) as validate_source_uuid, assignment_id, cast(assignment_uuid AS VARCHAR(255)) as assignment_uuid , obs_sub_type , key_col_nm , key_col_value, target_link_id, source_link_id, target_col_nm, target_col_value, source_col_nm, source_col_value, confidence , cnt from public.validate_source_value

                                           
    0
             
  • danieljdavis

    danieljdavis

    14 days ago
    Rename a connection in place?

    Data Quality version: 2025.01-ABDGCSHILM-4246 (I tried searching through these forums, but there doesn't seem to be an obvious way to do that either.) Is there no way to rename a connection in place? (Or, I should say, actually rename a connection?) Using the rename action from the dropdown just creates a new connection with the new name and doesn't bring over any existing datasets.

                                           
    1
             
  • Grant Rollerson

    Grant Rollerson

    22 days ago
    DQO Classic - Fastlink to Break Records

    Does anyone have the same issue a DQ Job with a Custom Rule which breaks every day, because of the same record(s) ... which is a known false positive the DQ Analyst daily receives an email generated by an Alert, goes into DQO dataset (DQ Job) and confirm the break is the one they see daily and not a real break ... so there's no real issue but it's a pain in the neck and a waste of his/her time So Get the rule changed to explicitly exclude that record from the test, which is pretty hacky OR is there any other way to solve this issue in a more programmatic way? either have the Custom Rule "learn" to accept that record or include the actual Break Records in the email, or post a fast link to same Nothing definitive in Ideation but I see; Possibility to Add Customizable Columns for DQ | Ideation platform Brad Fuchs 31 Mar, 2025 We are working to make the break record experience more cohesive. Please keep an eye on upcoming releases as changes will start to roll out.

                                           
    1
             
  • Dan Everett

    Dan Everett

    28 days ago
    Collibra Data Quality and Observability 2025.05

    Yesterday Collibra Data Quality & Observability 2025.05 was released. Release notes are here. https://productresources.collibra.com/docs/collibra/latest/Content/DataQuality/release-notes.htm

                                           
    1
             
  • danestep

    danestep

    1 month ago
    DG to DQ Valid Values Rule Updates

    Is there any way to take advantage of DG Code sets within CDQ Custom Rules? I am wanting the steward work within the catalog and affiliated code sets to become the updated input into a data class / data quality rule. The desired outcome is that the definition of valid values can be owned by the catalog steward, and as they are updated, the job has maintenance applied by accepting updates or referring back to the current catalog resources. Today we're hardcoding the rules and would be updating in a very manual notification way. Thank and Regards, Dan

                                           
    3
             
  • emiliawalencik1

    emiliawalencik1

    1 month ago
    Asset Quality Page
                             

    Hello there, Can anyone guide me on how to set up the aggregation path and relations to view different charts representing various quality dimensions? I'm failing to do so, I have no idea where I'm making a mistake. This is the quality tab view I currently see: This is the aggregation path I created: This is a traceability diagram:

                                           
    1
             
  • sudhirnune

    sudhirnune

    1 month ago
    SAP S4 - ECC Connectivity to Collibra DQ View HANA and Performances Impact

    We are planning to connect to SAP S4 ECC over HANA backend for running Data Quality rules. We would like to understand if we have implemented this connectivity to S4 HANA Backend of ECC applications. If yes need help with Did you choose Pull Up / Push Down Do you see any issue with the performance of the S4 been impacted Any sizing / performance bench marks created

                                           
    0
             
  • hyoosaf

    hyoosaf

    2 months ago
    Postgres metastore tables where the metabar details of Collibra DQ dataset findings page are stored
                             

    Hello there, Can anyone help me understand from which Postgres metastore tables the metabar details of Collibra DQ dataset findings page are fetched - Screenshot attached. To be more specific, would like to know where the below are stored : 1.column count 2.Source details 3.Data Category Thanks, Hazeena

                                           
    4
             
  • Dan Everett

    Dan Everett

    2 months ago
    Understanding Rule Scores

    There is some new documentation to help you better understand rule scores. https://productresources.collibra.com/docs/collibra/latest/Content/DataQuality/DQCoreComponents/Rules/co_rules-score.htm

                                           
    3
             
  • saritawaghmare

    saritawaghmare

    5 months ago
    Rule migration from DQ to DG(DQ to DG rule integration)

    HI Team, I need to know rule created in DQ i.e. migration from DQ to DG. Kindly guide or provide link if any video or documentation related to this. Thanking you. Regards, Sarita

                                           
    2
             
…