6 Messages
DBT to collibra integration - Multiproject and standalone mode compatibility
Hello community,
We are looking into integrating DBT into Collibra with the client. The documentation mentions DBT Cloud, and the client is wondering about the compatibility of the connector with DBT in standalone mode. Do you know if the connector would work with this mode, or do we have to be on DBT Cloud?
We are also wondering if it’s possible to scan multiple DBT projects at once in Collibra.?
Thank you in advance for your help.
Hajar.
antoniocastelo
18 Messages
2 years ago
Hi, the integration can scan all projects in an account, a list of projects or a given project depending from the http request sent. For each project it creates a job if not found and compiles it all before collecting the compiled sql. It also collects meta, metrics, exposures., tests . You’ll necessarily need the dbt metadata apis.
0
0
SheeriCabral
30 Messages
2 years ago
I can’t speak to metadata importing; however, one possibility that will work today, is to try running “dbt compile” and sending the SQL to the lineage harvester as with any JDBC data source in folder (CLI) or Shared Storage mode (Edge) as shown here: https://productresources.collibra.com/docs/collibra/latest/Content/CollibraDataLineage/TechnicalLineage/ref_technical-lineage-supported-data-sources.htm#tab-2
0
0