Collibra Community

Integrations

Created Feb 16, 2024

1 member

244 discussions

Welcome to the Integrations Discussions space—a dedicated forum for sharing insights, asking questions, and collaborating on integrating Collibra with various systems. Whether you're connecting to data sources, configuring APIs, or exploring new integration possibilities, this is your community to engage with peers and experts, enhancing your data intelligence journey.

user_13b054
25 days ago
OpenAPI to Collibra Integration - How to add additonal asset types in this hierarchy
OpenAPI to Collibra Integration contains asset hierarchy API ->API Endpoint ->Code Value ->Data Structure -> Data Element but API endpoint would contain "parameters", "responses", "requestBody" and these would contain "Code Value"

How to add this additional hierarchy level API Operation Object ("parameters", "responses", "requestBody") under API endpoint ?

0

c_ventola

1 month ago

Fivetran to Collibra integration - encountering response header issues

Hi, I am trying to get the Fivetran integration working and am encountering the error below. I am not a developer but it seems to imply that Fivetran is not sending json back in the response? I saw a post about this integration from about two and a half years ago, I wonder if there have been changes made on the Fivetran side since then. Taking a stab in the dark here and hoping that the developer @ralphosmond_rimorin is still with Collibra and could take a look? Also tagging @springboot_team from the original post replies.

Anyone else in the community use this integration and have it running? Thanks!

HTTP response headers:
HTTPHeaderDict({
    'set-cookie': 'XXXXXXXXXXXXXXX; Path=/; Secure; HttpOnly',
    'referrer-policy': 'no-referrer',
    'x-frame-options': 'DENY',
    'strict-transport-security': 'max-age=63072000; includeSubDomains;',
    'x-content-type-options': 'nosniff',
    'content-security-policy': "default-src 'none'; frame-ancestors 'none'",
    'x-xss-protection': '1; mode=block',
    'cache-control': 'no-cache,no-store',
    'content-type': 'application/json',
    'content-length': '90',
    'date': 'Thu, 13 Feb 2025 14:56:20 GMT',
    'server': 'istio-envoy',
    'x-envoy-upstream-service-time': '0'
})

HTTP response body:
b'{"statusCode":406,"titleMessage":"Not Acceptable","userMessage":"HTTP 406 Not Acceptable"}'

marcinnowicki
5 months ago
collibra-integration-library-sb3-1.0.1 no longer compatible with Workflow Definition API
Dear @springboot_team,

We've recently upgraded Collibra to 2024.10 and turns out that the latest integration library (1.0.1) for Spring Boot 3 is now longer compatible with Collibra Workflow Definition API.

When deploying the definition, API client throws an deserialization exception due to missing `Role` enum value:

Caused by: feign.FeignException: Cannot construct instance of `com.collibra.marketplace.library.generated.core.model.RoleImpl$PermissionsEnum`, problem: Unexpected value 'INSIGHTS_VIEW'
at[Source: (BufferedReader); line: 1, column: 2533](through reference chain: com.collibra.marketplace.library.generated.core.model.WorkflowDefinitionImpl["startRoles"]>java.util.ArrayList[0]>com.collibra.marketplace.library.generated.core.model.RoleImpl["permissions"]->java.util.ArrayList[14]) reading POSThttps://***.collibra.com/rest/2.0/workflowDefinitions

A quick workaround is to allow embedded object mapper to read unknown enum values:

apiClient.getObjectMapper().enable(DeserializationFeature.READ_UNKNOWN_ENUM_VALUES_AS_NULL);

Besides that I've noticed that the API class provides a `void` types for `getWorkflowDefinitionDiagram()` and `getWorkflowDefinitionXML()` methods, making them useless.

Are there any plans for library update?
3
damienrembert
7 months ago
The Spring Boot Integration Library Seems to Ignore Proxy
Hello,

I'm trying to connect to Collibra in a Spring Boot Project using Collibra's Spring Boot Integration library. It seems to work fine initially, and I can use the CollibraImportApiHelper class to access assets. In the logs I can see:

2024-08-14T17:30:24.940+01:00 INFO 33676 --- [ main] .c.m.l.i.InternalSharedLibraryConnection : Authenticating with the Collibra Platform...
2024-08-14T17:30:26.475+01:00 INFO 33676 --- [ main] .c.m.l.i.InternalSharedLibraryConnection : Successfully authenticated with the Collibra Platform.

So, there is a connection to Collibra. If I try to use CollibraImportApiHelper or CollibraExportApiHelper, everything works as expected.

If I try to use CollibraCoreApiHelper or UsersApi however, any call that I make seems to try (and fail) to initiate another connection.

I can see in the logs that I'm getting "RBAC: Access Denied" from the Collibra instance I'm trying to hit. The RBAC error is the response we get when trying to access Collibra without using the company proxy.

Caused by: feign.FeignException$Forbidden: [403 Forbidden] during [GET] to [https://mydomain.collibra.com/rest/2.0/domains?limit=99999999&name=DamienBusiness%20Data%20Quality%20Rule&nameMatchMode=EXACT] [DomainsApi#findDomains(Map)]: [RBAC: access denied]

at feign.FeignException.clientErrorStatus(FeignException.java:226) ~[feign-core-12.1.jar!/:na]

at feign.FeignException.errorStatus(FeignException.java:203) ~[feign-core-12.1.jar!/:na]

at feign.FeignException.errorStatus(FeignException.java:194) ~[feign-core-12.1.jar!/:na]

at feign.FeignException.errorStatus(FeignException.java:171) ~[feign-core-12.1.jar!/:na]

at feign.codec.ErrorDecoder$Default.decode(ErrorDecoder.java:92) ~[feign-core-12.1.jar!/:na]

at feign.ResponseHandler.decodeError(ResponseHandler.java:136) ~[feign-core-12.1.jar!/:na]

at feign.ResponseHandler.handleResponse(ResponseHandler.java:70) ~[feign-core-12.1.jar!/:na]

at feign.SynchronousMethodHandler.executeAndDecode(SynchronousMethodHandler.java:116) ~[feign-core-12.1.jar!/:na]

at feign.SynchronousMethodHandler.invoke(SynchronousMethodHandler.java:72) ~[feign-core-12.1.jar!/:na]

at feign.ReflectiveFeign$FeignInvocationHandler.invoke(ReflectiveFeign.java:98) ~[feign-core-12.1.jar!/:na]

at jdk.proxy2/jdk.proxy2.$Proxy128.findDomains(Unknown Source) ~[na:na]

at com.collibra.marketplace.library.integration.CollibraCoreApiHelper.getDomainId(CollibraCoreApiHelper.java:257) ~[collibra-integration-library-sb3-1.0.1.jar!/:1.0.1]

My guess is that there is something different in how the Import/Export helpers get their connection and how the other API helpers do it. But I can't figure out how to step around it. Is there a way to access the connection created by InternalSharedLibraryConnection?

Any suggestion would be greatly appreciated.

Thanks!

1
aditya_pawar_DE
7 months ago
Dependency 'io.swagger:collibra-core:1.0.0' not found
Hi Collibra Team

We were exploring this marketplace listing and received below error :

Dependency 'io.swagger:collibra-core:1.0.0' not found

for following dependency:

<dependency>
<groupId>io.swagger</groupId>
<artifactId>collibra-core</artifactId>
<version>1.0.0</version>
<scope>compile</scope>
</dependency>

Earlier we thought its due to missing Spring Boot Integration Library (Spring Boot 2.x) jar but this jar is different and not found in marketplace.

Any help to point me in right direction will help.

Thanks,

Aditya Pawar
1
gabrielechristensen
7 months ago
Getting the Domain ID from an asset Object
Hi everyone,

For my workflow, I need to get the Domain ID for an asset. I have retrieved the asset object successfully find the FindAssetsRequest.builder.
I tried different ways, but keep running into errors retrieving the Domain ID from that Object. The bolded is what I need. getDomain().getId() did not work.

Here is my object for reference.

[AssetImpl{displayName=howlite, articulationScore=80.0, excludedFromAutoHyperlinking=false, domain=NamedResourceReference{name='saras_datalake > saras_prod > howlite'} ResourceReferenceImpl{id=f47d37b0-4f99-42f3-96d7-c8fee7bff117, resourceType=Domain}, type=NamedResourceReference{name='Schema'} ResourceReferenceImpl{id=00000000-0000-0000-0001-000400000002, resourceType=AssetType}, status=NamedResourceReference{name='Accepted'} ResourceReferenceImpl{id=00000000-0000-0000-0000-000000005009, resourceType=Status}, avgRating=0.0, ratingsCount=0} NamedResource{name='saras_datalake>saras_prod>howlite'} Resource{createdBy=fffcc2f9-b27f-44d7-8335-cb5fdbf45ba0, createdOn=1692187791719, lastModifiedBy=b953a84f-3ed7-4ddf-8b1e-05b49c7ecb9a, lastModifiedOn=1715980991426, system=false, resourceType=Asset} EntityImpl{id=5e7b2cda-9402-4f3d-ba9e-44e165c56a88}, AssetImpl{displayName=howlite_callcenter, articulationScore=80.0, excludedFromAutoHyperlinking=false, domain=NamedResourceReference{name='saras_datalake > saras_prod > howlite_callcenter'} ResourceReferenceImpl{id=018e9d2d-cc53-76cd-a302-57f0d033d5d3, resourceType=Domain}, type=NamedResourceReference{name='Schema'} ResourceReferenceImpl{id=00000000-0000-0000-0001-000400000002, resourceType=AssetType}, status=NamedResourceReference{name='Accepted'} ResourceReferenceImpl{id=00000000-0000-0000-0000-000000005009, resourceType=Status}, avgRating=0.0, ratingsCount=0} NamedResource{name='saras_datalake>saras_prod>howlite_callcenter'} Resource{createdBy=00000000-0000-0000-0000-000000900001, createdOn=1712034013942, lastModifiedBy=b953a84f-3ed7-4ddf-8b1e-05b49c7ecb9a, lastModifiedOn=1715979876206, system=false, resourceType=Asset} EntityImpl{id=018e9d2d-e2b5-7be0-b19d-9458632be22b}, AssetImpl{displayName=howlite_callcenter_deab, articulationScore=80.0, excludedFromAutoHyperlinking=false, domain=NamedResourceReference{name='saras_datalake > saras_prod > howlite_callcenter_deab'} ResourceReferenceImpl{id=018e9d2d-cf45-7d0c-a7bb-6b824280553e, resourceType=Domain}, type=NamedResourceReference{name='Schema'} ResourceReferenceImpl{id=00000000-0000-0000-0001-000400000002, resourceType=AssetType}, status=NamedResourceReference{name='Accepted'} ResourceReferenceImpl{id=00000000-0000-0000-0000-000000005009, resourceType=Status}, avgRating=0.0, ratingsCount=0} NamedResource{name='saras_datalake>saras_prod>howlite_callcenter_deab'} Resource{createdBy=00000000-0000-0000-0000-000000900001, createdOn=1712034013942, lastModifiedBy=eb18f12f-496a-44c4-b0ae-aed1566e7d24, lastModifiedOn=1722946942586, system=false, resourceType=Asset} EntityImpl{id=018e9d2d-e2b5-7be0-b19d-9458632be235}, AssetImpl{displayName=howlite_callcenter_dep, articulationScore=80.0, excludedFromAutoHyperlinking=false, domain=NamedResourceReference{name='saras_datalake > saras_prod > howlite_callcenter_dep'} ResourceReferenceImpl{id=018e9d2d-d00b-71ea-93a0-4aa7bbc25806, resourceType=Domain}, type=NamedResourceReference{name='Schema'} ResourceReferenceImpl{id=00000000-0000-0000-0001-000400000002, resourceType=AssetType}, status=NamedResourceReference{name='Accepted'} ResourceReferenceImpl{id=00000000-0000-0000-0000-000000005009, resourceType=Status}, avgRating=0.0, ratingsCount=0} NamedResource{name='saras_datalake>saras_prod>howlite_callcenter_dep'} Resource{createdBy=00000000-0000-0000-0000-000000900001, createdOn=1712034013941, lastModifiedBy=eb18f12f-496a-44c4-b0ae-aed1566e7d24, lastModifiedOn=1722946942586, system=false, resourceType=Asset} EntityImpl{id=018e9d2d-e2b5-7be0-b19d-9458632be234}, AssetImpl{displayName=howlite_cust_enrollment, articulationScore=80.0, excludedFromAutoHyperlinking=false, domain=NamedResourceReference{name='saras_datalake > saras_prod > howlite_cust_enrollment'} ResourceReferenceImpl{id=018e9d2d-d0dd-7cf3-bdbd-6ee1a476e936, resourceType=Domain}, type=NamedResourceReference{name='Schema'} ResourceReferenceImpl{id=00000000-0000-0000-0001-000400000002, resourceType=AssetType}, status=NamedResourceReference{name='Accepted'} ResourceReferenceImpl{id=00000000-0000-0000-0000-000000005009, resourceType=Status}, avgRating=0.0, ratingsCount=0} NamedResource{name='saras_datalake>saras_prod>howlite_cust_enrollment'} Resource{createdBy=00000000-0000-0000-0000-000000900001, createdOn=1712034013942, lastModifiedBy=b953a84f-3ed7-4ddf-8b1e-05b49c7ecb9a, lastModifiedOn=1715979982173, system=false, resourceType=Asset} EntityImpl{id=018e9d2d-e2b5-7be0-b19d-9458632be22c}, AssetImpl{displayName=howlite_cust_portfolio, articulationScore=80.0, excludedFromAutoHyperlinking=false, domain=NamedResourceReference{name='saras_datalake > saras_prod > howlite_cust_portfolio'} ResourceReferenceImpl{id=018e9d2d-d19a-7359-9122-42e40719ea7c, resourceType=Domain}, type=NamedResourceReference{name='Schema'} ResourceReferenceImpl{id=00000000-0000-0000-0001-000400000002, resourceType=AssetType}, status=NamedResourceReference{name='Accepted'} ResourceReferenceImpl{id=00000000-0000-0000-0000-000000005009, resourceType=Status}, avgRating=0.0, ratingsCount=0} NamedResource{name='saras_datalake>saras_prod>howlite_cust_portfolio'} Resource{createdBy=00000000-0000-0000-0000-000000900001, createdOn=1712034013942, lastModifiedBy=b953a84f-3ed7-4ddf-8b1e-05b49c7ecb9a, lastModifiedOn=1715979982173, system=false, resourceType=Asset} EntityImpl{id=018e9d2d-e2b5-7be0-b19d-9458632be233}]+++++++++++++++++ [authenticated_id=fffcc2f9-b27f-44d7-8335-cb5fdbf45ba0, session_hash=b1e52501bc212f85a01c5311aa585dfd, trace_id=3bd8920e832a777c3545de3b73e5fc90, trace_flags=01, span_id=6d433ef8b3a40401]

2024-08-26 18:47:55.026 [http-nio-0.0.0.0-4400-exec-234] WARN c.c.d.w.s.g.b.SecureGroovyTaskActivityBehavior - Exception while executing scriptTask4 : groovy script evaluation failed: 'javax.script.ScriptException: groovy.lang.MissingMethodException: No signature of method: java.util.ArrayList.getDomain() is applicable for argument types: () values: []

Possible solutions: getClass(), getLast()' Trace: scopeType=bpmn, scopeDefinitionKey=dataTransformationRequestDTRCreate, scopeDefinitionId=019190df-561e-7d1e-863e-ac930a5b40b0, subScopeDefinitionKey=scriptTask4, tenantId=<empty>, type=scriptTask [authenticated_id=fffcc2f9-b27f-44d7-8335-cb5fdbf45ba0, session_hash=b1e52501bc212f85a01c5311aa585dfd, trace_id=3bd8920e832a777c3545de3b73e5fc90, trace_flags=01, span_id=0135634aa02a4480]

2024-08-26 18:47:55.026 [http-nio-0.0.0.0-4400-exec-234] ERROR c.c.d.c.w.a.WorkflowExceptionHandler - Error when completing task with id: 019190df-82d8-7581-b2db-1cd7f22dcbf6 [authenticated_id=fffcc2f9-b27f-44d7-8335-cb5fdbf45ba0, session_hash=b1e52501bc212f85a01c5311aa585dfd, trace_id=3bd8920e832a777c3545de3b73e5fc90, trace_flags=01, span_id=0135634aa02a4480]

2
user_67b1f6
7 months ago
Collibra API Integration
Hi Team,

We have a use case to expose our PostgressSQL data on collibra data catalog, we need to use the API endpoints to tweak them. Do we have python SDKs so that we can manage efficient error handling? Please provide all the related documents, would really appreciate it.

Thanks!

1
user_b659a7
7 months ago
Struggling with API Integration - Any Advice?
Hi everyone,

I'm hoping someone can help me out with an issue I've been running into with Collibra's API integration. Every time I try to connect our internal system with Collibra through the API, I'm getting repeated timeouts and authentication errors. When I was searching about this I came across these resources/articles- Integrations and APIs ServiceNow Tutorial and as per them, I've double-checked the credentials and tried different approaches, but nothing seems to work.

Has anyone else experienced this? Maybe there's a setting or step I'm missing?

Any advice or pointers would be really helpful. Thanks a lot!

Looking forward to your suggestions.

Best Regards,

1
kaustuvdeloitte
7 months ago
Exporting data classifications of a column
Hi all,

We are currently working on a use case to export detailed information about columns within a specific domain, including column names, attributes, and data classifications. However, we have encountered a challenge: the classification related to a column is not an attribute type, and therefore, we cannot directly add it to the view for export.

To address this, we are considering the following approach:

Retrieve Column Details: Utilize APIs in Python to obtain a list of all columns within the specified domain.

Extract Classifications: Use the classification API to extract the classifications associated with each column.

Export to Excel: Compile the information, including column names and their respective classifications, into an Excel file.

We would appreciate any guidance or best practices on how to effectively implement this solution or if there is any other solution apart from this.

Thank you for your assistance.

Best regards,

Kaustuv
1
DJasinski
8 months ago
Extracting KPI definitions from database views
Hello,

In my organization there are several hundred KPIs defined in a views. (For example, there is CustomerKPI view select a * b / c as CustomerScore1 definition.

Is there a way in Collibra to automatically extract those definitions for purposes of crating KPI catalog? If so, how? Do we need to create a custom API connector for this? Use lineage harvester?

Regards,

Darek

1

OpenAPI to Collibra Integration - How to add additonal asset types in this hierarchy

Fivetran to Collibra integration - encountering response header issues

collibra-integration-library-sb3-1.0.1 no longer compatible with Workflow Definition API

The Spring Boot Integration Library Seems to Ignore Proxy

Dependency 'io.swagger:collibra-core:1.0.0' not found

Getting the Domain ID from an asset Object

Collibra API Integration

Struggling with API Integration - Any Advice?

Exporting data classifications of a column

Extracting KPI definitions from database views

OpenAPI to Collibra Integration - How to add additonal asset types in this hierarchy

Fivetran to Collibra integration - encountering response header issues

collibra-integration-library-sb3-1.0.1 no longer compatible with Workflow Definition API

The Spring Boot Integration Library Seems to Ignore Proxy

Dependency 'io.swagger:collibra-core:1.0.0' not found

Getting the Domain ID from an asset Object

Collibra API Integration

Struggling with API Integration - Any Advice?

Exporting data classifications of a column

Extracting KPI definitions from database views