101 Messages
TO BE REVIEWED: How can I access my Databricks cluster using Collibra DQ?
Q: How can I access my Databricks Delta Lake cluster via JDBC?
Answer from Brian Mearns:
Based on the recurring feedback, we decided to prioritize the development. The expected release date is 2022.05 for a default-packaged Databricks JDBC connector.
There are 3 primary ways customers desire to use their Databricks infrastructure. Below is how customers can run DQ with Databricks infrastructure.
- JDBC
https://docs.databricks.com/integrations/bi/jdbc-odbc-bi.html#jdbc-driver
- We intend to add the driver packaging to our containers starting 2022.05 release.
- NOTEBOOK
https://docs.databricks.com/notebooks/index.html
- We will continue to support this. This has been used for several years.
- SPARK SUBMIT / JOB API
https://docs.databricks.com/dev-tools/api/latest/examples.html#create-a-spark-submit-job
https://docs.databricks.com/dev-tools/api/latest/jobs.html
- At this time, we are not able to prioritize work for building custom spark submissions.
No Responses!