Ability to ingest system-versioned Temporal tables from source DB

As we have ingested a new SQL server Database in our DEV environment of Data Intelligence Cloud using EDGE, we are noticing that a system-versioned temporal table does not appear in Data Intelligence Cloud.

Would someone be able to confirm that this is intended, or should we be able to see it? I was unable to find any supporting documentation on the Collibra product documentation site.

Thank you in advance, and I apologize if this information is already available.

RandyEngelmayer

Posted 3 years ago · Edited 2 years ago·Last reply 3 years ago

7 comments

RandyEngelmayer

OP3 years ago · Edited

Hi Bineesh,
Thank you for your feedback - yes, it’s related to only the metadata. We are not profiling this table at this time.

I have proceeded with submitting a Collibra Support ticket and will work with him/her to find out what might be causing it. Thanks again for your help.

Randy

bineeshbabu

·3 years ago · Edited

Hello @randolf.engelmayer.tivityhealth.com ,

If I understand it correctly the system-versioned temporal table is a table with all the previous updated data.

If yes, then its actual data. In collibra we dont store real data, we only store metadata like table, column name.

Now if you still want to see the data from system-versioned temporal table then you need to use our Sampling capability

https://productresources.collibra.com/docs/collibra/latest/Content/Catalog/SampleData/co_sample-data.htm

This will give you access to data in system-versioned temporal table

See below sample

If your question is about not able to see the metadata related to system-versioned temporal table … Like Table and Column name then it might be a bug . Please check if you are using CDATA driver which is from our Data Marketplace ,

JDBC Driver for SQL Server - Collibra Marketplace

The JDBC driver allows Collibra Catalog to register SQL Server data sources.

if yes then please raise a support ticket

Thanks
Bineesh

christina_brashear

·3 years ago · Edited

Hi @randolf.engelmayer.tivityhealth.com,

I have not had any luck yet, but am still working on it. Thank you for your patience!

-Christina

RandyEngelmayer

OP3 years ago · Edited

Does anyone have any thoughts or recommendation on this item?

christina_brashear

·3 years ago · Edited

Hi @randolf.engelmayer.tivityhealth.com,

Thanks for reaching out with your question. Let me reach out internally to see if someone is able to help you determine if this is intended behavior.

Thanks!
-Christina
Senior Manager, Community Success

RandyEngelmayer

OP3 years ago · Edited

Does anyone have any thoughts or recommendation on this item?

RandyEngelmayer

OP3 years ago · Edited

Hi @christina , did you have any luck finding out more related to this question?
Thanks again for your help.