L

Wednesday, April 20th, 2022 1:21 PM

Closed

TO BE REVIEWED: How can I access my Databricks cluster using Collibra DQ?

Q: How can I access my Databricks Delta Lake cluster via JDBC?
Answer from Brian Mearns:
Based on the recurring feedback, we decided to prioritize the development. The expected release date is 2022.05 for a default-packaged Databricks JDBC connector.

There are 3 primary ways customers desire to use their Databricks infrastructure. Below is how customers can run DQ with Databricks infrastructure.

  1. JDBC

https://docs.databricks.com/integrations/bi/jdbc-odbc-bi.html#jdbc-driver

- We intend to add the driver packaging to our containers starting 2022.05 release.

  1. NOTEBOOK

https://docs.databricks.com/notebooks/index.html

- We will continue to support this. This has been used for several years.

  1. SPARK SUBMIT / JOB API

https://docs.databricks.com/dev-tools/api/latest/examples.html#create-a-spark-submit-job

https://docs.databricks.com/dev-tools/api/latest/jobs.html

- At this time, we are not able to prioritize work for building custom spark submissions.

No Responses!
Loading...