assets export
Summary: Daphné OZBEK is experiencing an issue with exporting data from Collibra to Dataiku. They have multiple related objects for a given asset but are only receiving partial associations rather than the full Cartesian product of these relationships. They are seeking advice on how to configure the export or transformation to obtain all possible combinations.
I am working with Collibra and I need to export some datas.
For a given asset (A), I have multiple related objects: for example 3 data models and 2 QRULs.
When I export the data, I only get 3 rows where data models and QRULs are associated in a seemingly arbitrary or partial way.
However, I would expect to get the full Cartesian product of these relationships, meaning all possible combinations between the 3 data models and the 2 QRULs (so 6 rows in total).
How can I configure the export or transformation so that I get all possible combinations instead of only randomly matched pairs?
Thanks for your help
Daphné
George Cheung
·3 months agoHi Daphne,
I think the issue is the format you are exporting to - excel.
Because Excel wants to display this set of relations in a tabluar view, it tries to populate it in as few rows as possible.
A better way to export this is through api - using the output module api - and exporting it in a json format
Heres an example of what it could look like in json with a customized tableViewConfig:
...{ "FullName": "Given Asset A", "Id": "01234567-89AB-CDEF-FEDC-765432100000", "Data_Models": [ { "Data_Model_FullName": "DM1", "Data_Model_Asset_Id": "01234567-89AB-CDEF-FEDC-765432101111" }, { "Data_Model_FullName": "DM2", "Data_Model_Asset_Id": "01234567-89AB-CDEF-FEDC-765432102222" }, { "Data_Model_FullName": "DM3", "Data_Model_Asset_Id": "01234567-89AB-CDEF-FEDC-765432103333" } ], "QRULs": [ { "QRUL_FullName": "QRUL1", "QRUL_Id": "01234567-89AB-CDEF-FEDC-765432104444" }, { "QRUL_FullName": "QRUL2", "QRUL_Id": "01234567-89AB-CDEF-FEDC-765432105555" } ] }