Collibra Community

Asset Import & Export

Created Nov 18, 2023

8 members

16 discussions

The Asset Import & Export topic in the Collibra Community focuses on efficiently moving data assets into and out of the platform. Users share solutions for importing assets via spreadsheets or APIs, exporting revision history, mapping relationships, and handling permission-related challenges—ideal for teams managing bulk operations and data migrations.

daverichard
10 months ago
Ability to export Asset revision history?
Hello, We were recently asked if there is any way to get the history on changes to an asset. I know that each asset has its own history, but I cannot seem to find a way to export that history. I know there was a discussion in the old forum, but I cannot remember if it ended up with any solutions.

5
Wendy_Z
11 months ago
candidate user problem
I got this error when I tried to add a new asset : Candidate User Problem There were no suitable candidate(s) for the task 'Review update (AC)' with the role 'Area Coordinator' for 'STU - GradFund - Graduate Student Funding' or they don't have permission to participate in workflows. Does anyone know how to resolve it? Thanks!

4
gbas
1 year ago
Issues to use import api for different users
Hello Team, I am importing the json data to collibra using rest import API. if user have sysadmin group he can able to import data in lesser time but if user doesn’t have the sysadmin group it will take more to import. What was the issue ? Thanks, Gobi

0
richardcohen
1 year ago
Creating Relationships When Loading Assets With Spreadsheets
For the past 3 years I’ve been loading data dictionary metadata into Collibra using Excel spreadsheets. Till now I’ve been able to successfully create a relationship by providing just the Full Name and Domain of the target asset type. Recently I received an error message “Important Conflict: The domain type for the creation of domain ‘xxxxx’ is missing.” I was trying to create a new Schema and relate it to an existing Component with the “is part of” relation. The Domain has been in existence for years and I was able to create this link in the past. Can someone explain what has gone wrong?

9
stephenlindsey
1 year ago
Importing Code Sets from database
Hi I was hoping to import Code Sets from tables in our database (we call them Lookup tables) however I can’t see anyway to load these into codesets automatically These tables do change over time, and I want to be able to see new values Wondering if anyone has hit this ? Thanks for any help, Stephen Lindsey

2
aditiamdekar1
2 years ago
Import API to update Full names of Assets: How to
Tried to update the full name of Assets using Import API as something like this: id is the collibra identifier (id) { “id”: $collibra_id, “name”: ", “resourceType”: “Asset”, “domain”: { “id”: “” }, “type”: { “name”: “” } } This just created new Assets, but needed t just update the existing assets with updated full names How can this be done?

1
ivanstrek
2 years ago
Excel Import / Export GUI relations mapping bad logic
Dear all, I would like to raise issue with latest GUI for Import / Export in Collibra. Main problem is that GUI is not exporting relations with Head included in column header… It exports and import only relationRole -Tail name. So if we have relations like: Report - sources/targets - Table and FIle - sources /targets- Table, in export file we will have two columns with same header “sources > [Table]”. Funny thing is that because of this Collibra is not able to Import its own Export file because is not able to automaticaly find and map relations due to this bad export naming. Second great thing about this Import mapping logic of partial relation names is, that if we have (due to different UC) two relations which differ by direction: Code Value - is part of/contains - Code Set and Code Set - contains/is part of - Code Value, Collibra allow to create this relations BUT it considers them as same one, so in Import mapping is not able to map them even we have in import file only one column header “contains > [Code Value]”. We have to map it manually and give 50:50 try as dropdown in mapping will offer two same options “Code Set contains Code Value”, even direction is different so it is NOT true. All of this issues could be easely solved just with adding “HEAD” asset into export (column headers) / import (mapping dropboxes right direction)

0
ericgerstner
3 years ago
HA/DR on CDQ
Does anyone have experience demonstrating data retention capabilities? I have been having a lot DR conversations with clients lately and would like to learn the best way to show value.

1
BigDataBear
3 years ago
How can I determine which REST API invocation is being used by the DQ Web Application so I can recreate the functionality programmatically?
Q: How can I determine which REST API invocation is being used by the DQ Web Application so I can recreate the functionality programmatically? Answer from Brian Mearns and Laurent: I navigated to this page on my side, Home > Jobs > Dataset > Rules And I used the Chrome browser’s View > Developer > Developer Tools to inspect what APIs are being used to build this page. Using my own dataset: PUBLIC.EMPLOYEES . I found this one which seems to be the important one for you (use your dataset name): /v2/getrules?dataset=your-dataset-name Which gives the results as a set of JSON documents, each document has this format: {"dataset":"PUBLIC.EMPLOYEES","ruleNm":"DEPT_IS_VALID","ruleType":"SQLF","ruleValue":"select department from @PUBLIC.EMPLOYEES EXCEPT select department from @PUBLIC.REFERENCE_DEPT","points":1,"perc":1.0,"ruleRepo":"","isActive":1,"userNm":"ben","exception":"","columnName":"STATE","businessCategory":"Validity","businessDesc":"Valid Department name","dimId":null,"dimName":null,"ruleValueBuilder":"{\"condition\":\"AND\",\"rules\":[{\"id\":null,\"field\":null,\"type\":null,\"input\":null,\"operator\":null}],\"not\":false,\"valid\":false}","previewLimit":6,"runTimeLimit":30.0,"scoringScheme":0,"active":true} Enjoy.

0
BigDataBear
3 years ago
What is Livy used for in the Collibra DQ software?
Question: What is Apache Livy used for in the Collibra DQ software? Answer is from Uday Velayudam: “Essentially, Livy is required to do estimation with data/filtergrams, preview, etc for any large files on remote file systems (HDFS/GCS/S3/Azure).”

0

Ability to export Asset revision history?

candidate user problem

Issues to use import api for different users

Creating Relationships When Loading Assets With Spreadsheets

Importing Code Sets from database

Import API to update Full names of Assets: How to

Excel Import / Export GUI relations mapping bad logic

HA/DR on CDQ

How can I determine which REST API invocation is being used by the DQ Web Application so I can recreate the functionality programmatically?

What is Livy used for in the Collibra DQ software?