Using non-default posgres user in Databricks for Metastore

Hello DQ Experts,

Can we use non-default database user for connectivity in Databricks environment. Additionally, What are the minimum permissions required for the metastore database users? Would be great, if anyone can share documentation for it. Thank you.

muhammadsalahuddin

Posted 3 years ago · Edited 1 year ago·Last reply 3 years ago

3 comments

BigDataBear

·3 years ago · Edited

Hi @muhammad.salahuddin.asic.gov.au , Salaam Aleikum,

You asked, “Can we use non-default database user for connectivity in Databricks environment.”
I have two ways of working with the Databricks environment, one is externally, using a Collibra DQ Databricks driver. The other is using a Databricks notebook internally, and reaching from Databricks to the DQ Metastore with the Collibra DQ Scala API. Can you please clarify what you mean to accomplish so we can answer more thoroughly?

muhammadsalahuddin

OP3 years ago · Edited

Hello @laurent.weichberger.collibra.com Wa Alaikum Assalam brother

Apology for not getting back due to workload. Thankfully, We have managed to fix it internally through local CollibraDQ support. However, We are facing a new issue in connecting to CollibraDQ metastore through API. Although, I am providing all praramters correct. The notebook is throwing following error on random basis.

muhammadsalahuddin

OP3 years ago · Edited

It would be great, if you can provide some advice on above issue. Thank you brother and salam O alaikum