Schema Refresh

Dear all,

I am attempting to get Collibra Edge detect new schemas in datasource and import into Collibra using the Synchronize metadata feature but it only refreshes existing imported schemas without adding the new ones in datasource.

Has anyone tried this?

victorabidoye

Posted 3 years ago · Edited 1 year ago·Last reply 8 months ago

7 comments

Hannah Kadron

·8 months ago

Did anyone find a better way to do this yet?

Andrew Southcombe

·8 months ago

We ended up writing a set of processes to do this via airflow and calling the catalog database registration API. They handle the creation of new database assets when new databases are added to our connections and creation of schema sync rules when new ones are added. Honestly, it is pretty complicated and we have had issues with scaling it out as we have about 2000 databases.

Hannah Kadron

·8 months ago

bummer, thanks for the info!

victorabidoye

OP3 years ago · Edited

Thank you @chuck.grissom

I have tried it, but I was wondering if it is possible to automate this process by scheduling it on Collibra DGC.

I also understand that there is a REST API to add new Schemas

Regards

victorabidoye

OP3 years ago · Edited

Thank you @chuck.grissom

I have tried it, but I was wondering if it is possible to automate this process by scheduling it on Collibra DGC.

I also understand that there is a REST API to add new Schemas

Regards

Mehjabeen Sultana

·1 year ago · Edited

I have tried this too. platform does not provide the option.

We have created a script with a bunch of api calls to get this done. But it is not efficient to have copies of these for each database

chuckgrissom

·3 years ago · Edited

Hi Victor,

You have to go into the database, select the configuration icon on the left, and then refresh the list of schemas to see any new ones that have been added. Then set up the the table rules to enable the refresh.

You may have already done that but I wasn’t sure if you had.

Chuck