Synchronising database/schema/table/column Assets via import API
We are working in data mesh environment and we have thousands of database schemas we want to synchronise metadata for into the Catalog. We are finding Edge awkward to work with at such a large scale so I’m exploring the idea of using the synchronisation facility of the Import REST API to build a custom integration.
My idea would be to define a synchronisation at either database or schema level and use this to create the database, schema, table/view and column assets with the appropriate attributes and relations. I would probably extract the data from Snowflake and then generate JSON files to submit as a sync job.
However, I’m having a little trouble figuring out the structure of the file I need to submit, particularly to ensure the relations are created. I wonder if anyone could have me out with an example? I’ve been through the documentation and the example here gave me a starting point, but I haven’t been able to work out the right way to structure it.
developer.collibra.com/tutorials/getting-started-with-the-import-api#asset-import-command
