J

51 Messages

 • 

200 Points

Sunday, November 1st, 2020 10:54 PM

Can I include table/column descriptions in a Collibra Catalog data source?

When registering a Data Source in Catalog, can I include the table/column descriptions?

3 Messages

4 years ago

Hi Jeffrey,

Depending on the data source and driver that you are using to ingest the physical data dictionary, you should be able to ingest the table and column descriptions.

51 Messages

 • 

200 Points

4 years ago

Edwin:
Is there any documentation on how to add other metadata properties to the Data Source?
Thanks…

36 Messages

4 years ago

Here is an article for Oracle data source.
https://support.collibra.com/hc/en-us/articles/360010145697-How-to-import-table-and-column-descriptions-from-Oracle-Data-Source-ingestion-with-Collibra-Catalog-

Could you please list which data sources you are trying to ingest?

Thank you!

3 Messages

This solution worked great for creating a new data source and capturing the comments, but it doesn’t seem to update an existing data source, even when I swap the driver configuration and perform a refresh. Is there an option to “overwrite” the description field for tables/columns that have already been created prior to enabling the comments?

51 Messages

 • 

200 Points

4 years ago

Arvind:
I’m ingesting standard SQL Server schemas using the generic JDBC SQL 2014 driver. This article refers to Oracle Bring-Your-Own-Drivers, so isn’t much help for this exercise. I don’t see a way to modify the Schema Refresh dialog to include other SQL Server metadata properties.

36 Messages

4 years ago

Jeff,
Oracle was an example and I wasn’t sure which database you were using. Could you please let me know where comments are stored on SQL server?

Is it via extended properties?

What’s your SQL query to see comments on table or column level?

51 Messages

 • 

200 Points

4 years ago

Great stackoverflow article. I didn’t create the schema so don’t know what they used for table/column comments. I’ll ask around.
Thanks!!!

3 Messages

4 years ago

Hi Jeffrey,

What additional SQL Server metadata properties that you want to ingest to Collibra?

It may be best to talk to Collibra Support if this is feasible.

51 Messages

 • 

200 Points

4 years ago

We want table descriptions and column descriptions. I’ll open a ticket.
Thanks…

36 Messages

4 years ago

@jeffrey.evoy were you able to get this working? It looks like Collibra has fixed the issue in 2021.02.01 release and you should be able to import descriptions from table and columns. Descriptions from system will go to new attribute called’ Description from source system’.

I tested it on one of my sql server and was able to import description at table and column level. I’m using Collibra provided driver from market place. As my SQL server is storing value in extended property, I used ‘Other’ property of driver with this value.

Other=TableExtendedProperty=MS_Description;ColumnExtendedProperty=MS_Description;

Thanks!

3 Messages

Dear @arvind.singh

I’ve been strugling for several days to obtain the comments from a sql server database using the marketplace jdbc driver. I applied your hint and it worked! So thank you so much for providing it.

Kind regards,

1.2K Messages

Such an underrated comment. Thanks a lot mate!

To bring this to life a tad bit more, we have multiple use cases where descriptions are initially mastered at the data source (as they aren’t held anywhere else!) but then mastered, refined and ratified in Collibra after onboarding.

Key thing to note is that you can control whether business metadata is extracted after your first ingestion so it’s well within the art of the possible to harvest technical and business metadata, refine the business metadata in Collibra and not worry about it being overwritten during data source resync :slight_smile:

Loading...