Collibra Community

Insights data access

Created Sep 3, 2024

1 member

3 discussions

The Insights Data Access topic in the Collibra Community is focused on extracting and working with data from Collibra Insights. Users discuss topics like incremental data loads, aggregating data quality scores, and exporting insights to tools like Tableau or Parquet. It’s ideal for teams integrating Collibra insights into broader analytics workflows.

user_9ab428
1 month ago
Incremental Data from Collibra Insights
Hi

We are trying to extract only incremental load of insights data between two dates instead of extracting the complete insights data from the two dates. Is there a way we can do it or has this been done in any organization.

Thanks

2
user_10b2fd
1 month ago
Aggregated data quality scores from DIP to Tableau
We have a medallion architecture implemented in snowflake. So, our bronze, silver, gold and semantic layer tables may have DQ scores for some of the tables. So, we have the following queries regarding this scenario.

1. We need to get the aggregated score of this lineage at the dashboard level, is it currently functioning as expected.

2. If not, what is the CDQ aggregation rule we need to use in the DIP for this to work

Please see the detailed attachment below.

2
akashpandey
6 months ago
Output Module to Parquet
Marketplace reference: https://marketplace.collibra.com/listings/output-module-to-parquet/

Getting the below error which packaging the app.

Caused by: com.collibra.marketplace.library.integration.exception.CollibraIntegrationLibraryException: {"message":"An unexpected error occurred during execution.","details":"Error reading entity from input stream.","cause":"Unrecognized field \"result\" (class com.collibra.internal.api.model.output.Job), not marked as ignorable (17 known properties: \"userId\", \"createdOn\", \"resourceType\", \"endDate\", \"name\", \"system\", \"startDate\", \"state\", \"visibility\", \"cancelable\", \"lastModifiedBy\", \"type\", \"id\", \"lastModifiedOn\", \"createdBy\", \"progressPercentage\", \"message\"])\n at [Source: (org.glassfish.jersey.message.internal.ReaderInterceptorExecutor$UnCloseableInputStream); line: 1, column: 377] (through reference chain: com.collibra.internal.api.model.output.Job[\"result\"])"}
Caused by: com.collibra.marketplace.library.integration.exception.CollibraIntegrationLibraryException: {"message":"An unexpected error occurred during execution.","details":"Error reading entity from input stream.","cause":"Unrecognized field \"result\" (class com.collibra.internal.api.model.output.Job), not marked as ignorable (17 known properties: \"userId\", \"createdOn\", \"resourceType\", \"endDate\", \"name\", \"system\", \"startDate\", \"state\", \"visibility\", \"cancelable\", \"lastModifiedBy\", \"type\", \"id\", \"lastModifiedOn\", \"createdBy\", \"progressPercentage\", \"message\"])\n at [Source: (org.glassfish.jersey.message.internal.ReaderInterceptorExecutor$UnCloseableInputStream); line: 1, column: 377] (through reference chain: com.collibra.internal.api.model.output.Job[\"result\"])"}
Caused by: javax.ws.rs.ProcessingException: Error reading entity from input stream.
Caused by: com.fasterxml.jackson.databind.exc.UnrecognizedPropertyException:
Unrecognized field "result" (class com.collibra.internal.api.model.output.Job), not marked as ignorable (17 known properties: "userId", "createdOn", "resourceType", "endDate", "name", "system", "startDate", "state", "visibility", "cancelable", "lastModifiedBy", "type", "id", "lastModifiedOn", "createdBy", "progressPercentage", "message"])
at [Source: (org.glassfish.jersey.message.internal.ReaderInterceptorExecutor$UnCloseableInputStream); line: 1, column: 377] (through reference chain: com.collibra.internal.api.model.output.Job["result"])

I am using the 1.1.7 version of the Collibra integration plugin. Is there any specific version of integration library compatible with this application? Moreover this integration plugin isn't readily available. Kindly advise.

0

Incremental Data from Collibra Insights

Aggregated data quality scores from DIP to Tableau

Output Module to Parquet

Incremental Data from Collibra Insights

Aggregated data quality scores from DIP to Tableau

Output Module to Parquet