Technical: Data Quality (DQ) Integration with Collibra Catalog

Please use this INTERNAL discussion thread to ask any technical questions about the Data Quality (DQ) Integration with Collibra Data Catalog. Below are some helpful resources to get you started.

Top Links

Collibra Native DQ Connector: [Click Here]
Collibra Native DQ Connector Official Collibra Documentation: [Click Here]
Native DQ Connector Unofficial User Guide (Step by Step Installation And Troubleshooting): [Click Here]
July 2021 Technical Wayfinder with DQ Connector Installation Demo - Presentation: [Click Here]
July 2021 Sales Wayfinder with DQ Connector End User Demo - Presentation: [Click Here]
July 2021 Technical Wayfinder - Video Recording: [Click Here]
July 2021 Sales Wayfinder - Video Recording: [Click Here]

Temporary Internal (Collibra-Only) Note (September - October 2021) To Access Data Quality UI Feature Flag:
Support will be needed to help issue the following command:
szabolcsbarany-MBP:dgc szabolcsbarany$ curl -v -u collibra:[REMOVED] https://console-cdq-dgc-testing.collibra.com/graphql -d’{“query”:“mutation ChangeDgcConfigurationMutation($input_0:ChangeDgcConfigurationInput!) {changeDgcConfiguration(input:$input_0) {clientMutationId}}”,“variables”:{“input_0”:{“dgcServiceId”:“DGCManagedServiceModel:85a195a8-b519-483e-9ba0-823d6f896d30”,“dgcConfiguration”:"{“ingestion”:{“databaseQuality”:true}}",“clientMutationId”:“e”}}}’ -H’content-type: application/json’

• Trying 34.117.160.200…
• TCP_NODELAY set
• Connected to console-cdq-dgc-testing.collibra.com (34.117.160.200) port 443 (#0)
• ALPN, offering h2
• ALPN, offering http/1.1
• successfully set certificate verify locations:
• CAfile: /etc/ssl/cert.pem
  CApath: none
• TLSv1.2 (OUT), TLS handshake, Client hello (1):
• TLSv1.2 (IN), TLS handshake, Server hello (2):
• TLSv1.2 (IN), TLS handshake, Certificate (11):
• TLSv1.2 (IN), TLS handshake, Server key exchange (12):
• TLSv1.2 (IN), TLS handshake, Server finished (14):
• TLSv1.2 (OUT), TLS handshake, Client key exchange (16):
• TLSv1.2 (OUT), TLS change cipher, Change cipher spec (1):
• TLSv1.2 (OUT), TLS handshake, Finished (20):
• TLSv1.2 (IN), TLS change cipher, Change cipher spec (1):
• TLSv1.2 (IN), TLS handshake, Finished (20):
• SSL connection using TLSv1.2 / ECDHE-RSA-CHACHA20-POLY1305
• ALPN, server accepted to use h2
• Server certificate:
• subject: C=BE; ST=Bryssel; L=Bryssel; O=Collibra N.V.; CN=*.collibra.com
• start date: Jun 8 00:00:00 2020 GMT
• expire date: Jul 13 12:00:00 2022 GMT
• subjectAltName: host “console-cdq-dgc-testing.collibra.com” matched cert’s “*.collibra.com”
• issuer: C=US; O=DigiCert Inc; OU=www.digicert.com; CN=Thawte RSA CA 2018
• SSL certificate verify ok.
• Using HTTP2, server supports multi-use
• Connection state changed (HTTP/2 confirmed)
• Copying HTTP/2 data in stream buffer to connection buffer after upgrade: len=0
• Server auth using Basic with user ‘collibra’
• Using Stream ID: 1 (easy handle 0x7fa9ab00c600)

POST /graphql HTTP/2
Host: console-cdq-dgc-testing.collibra.com
Authorization: Basic Y29sbGlicmE6MzcxQ1h6RnUwKkgq
User-Agent: curl/7.64.1
Accept: /
content-type: application/json
Content-Length: 340

• We are completely uploaded and fine
• Connection state changed (MAX_CONCURRENT_STREAMS == 100)!
  < HTTP/2 200
  < date: Thu, 23 Sep 2021 13:11:31 GMT
  < server: Apache
  < strict-transport-security: max-age=63072000; includeSubdomains;
  < x-frame-options: SAMEORIGIN
  < content-type: application/json
  < content-length: 60
  < set-cookie: ConsoleSessionId=b44a6956-4a47-4b8b-9516-422905497204; Path=/; Secure; HttpOnly; SameSite=lax
  < set-cookie: rememberMe=deleteMe; Path=/; Max-Age=0; Expires=Wed, 22-Sep-2021 13:11:30 GMT; SameSite=lax
  < via: 1.1 google
  < alt-svc: clear
  <
  
  
  
  
  
  
  
  
  
  
  
  
• Connection #0 to host console-cdq-dgc-testing.collibra.com left intact
  {“data”:{“changeDgcConfiguration”:{“clientMutationId”:“e”}}}* Closing connection 0

As of Collibra DGC 2021.11 thanks to Catalog team, the Quality tab Feature Flag WILL be exposed in Console

See reference ticket: http://collibra.zendesk.com/agent/tickets/73296