Hi, does someone know if it is possible to store XML-documents in Collibra and to display their XML-schemas in Collibra DGC?

Storing and displaying XML documents in Collibra | Product Q&A

stephaneschneider

·6 years ago · Edited

Jeroen, have you looked at our connector for XML sources: https://marketplace.collibra.com/listings/jdbc-driver-for-xml/
It does not create all the XML content in a single asset, but creates the structure like other catalog assets.

Former User

·5 years ago · Edited

Hi Stephane,

Would you please explain what asset types and relations are used? From the page referenced it looks like it uses Schemas, Tables, Columns, etc., but I found this confusing since documents don’t use this language and are structured differently than traditional relational systems. If you’re able to post an image of what the final result looks like that would be very helpful as well.

Thank you

arthurburkhardt

·5 years ago · Edited

That would be correct.
cdata JDBC drivers flatten documents so that you can query them just like relational databases. While that would be ok for flat documents, it is definitely inappropriate for complex json/xml/avro documents.
Also, it is impossible to faithfully retro document XSD from valid XML

No guarantee that all the parts of model is instantiated
No concept of inheritance structures, constraints, and other logic

What you would be probably looking to document would be an XSD (XML Schema Document). There is currently very limited support for such artifacts, and the best way to represent it would probably be to show it as a Data model with custom relations.

For all the topics of semi-structured data governance, it seems there is no good way to index the data, and typical approaches have been to stay away from the technical complexity and abstract the data into a more relational model.
Some examples presented by other collibra customers have shown that they preferred to use Collibra for the business documentation, and keep the technical documentation outside of collibra (i.e. service catalog, etc.)

jeroenvermunt

OP6 years ago · Edited

Hi Bridget,

thanks. Indeed the idea would be to display the XMLschema directly from Collibra, so without downloading the attachment first. Will ask my team to look further into previewing via API - do you know if there is any supporting API documentation specifically on this XML use case ?

best regards ,Jeroen

jeroenvermunt

OP6 years ago · Edited

Hi Bridget,

thanks. Indeed the idea would be to display the XMLschema directly from Collibra, so without downloading the attachment first. Will ask my team to look further into previewing via API - do you know if there is any supporting API documentation specifically on this XML use case ?

best regards ,Jeroen

Former User

·6 years ago · Edited

Hi Jeroen, I reached out to our Product Manager who said that there is no specific API, but he would, personally, try to convert it into an attribute and then check the attribute API. I hope that helps! If you need any additional guidance, I can connect you with your Customer Advisory Manager who can provide additional recommendations and connect you directly with other resources on our team. --Bridget, Collibra Team

Former User

·6 years ago · Edited

Hi Jeroen,
Thank you for reaching out. You can store XML document as attachments., but to render it you should download it. Or, you can use an integration which creates a preview by pushing the data through the APIs. Hope that helps.
-Bridget, Collibra Team

1	Grant Rollerson SUNCORP CORPORATE SERVICES PTY LTD
2	Tom Friesen Algonquin College
3	SB S Benson Plus3 IT
4	S stefan_busch
5	Brian Lloyd USA TODAY Co.
6	D daverichard