Denodo Sprinboot Integration

The problem is that some attributes in DGC are “special” and can only be written through the “profiling API”, such as the technical data types, percentiles, sample data, etc.
It seems there is an error in this integration and it’s trying to import such attributes through the import API instead of the profiling API.

I’m quite interested to make this denodo integration work, too!

Hi Ron, Arthur

Some of the attributes are reserved to be created/modified only by Catalog integrations (these are the ones whose system flag is true in the response of the Core REST API GET /attributes ). If you want to override the rule, you have to create a custom scope assignment for the asset type/s which contain these type of attributes.

Hello Ron,

Regarding setting up the Scopes, the following needs to be done:

Create the Scope

From the Collibra Platform instance, go to the Settings page and then:

1. Select “Scopes” from under “Operating Model”
2. From the Scopes page, select “Add” to add a new scope
3. Enter the scope name and select the community and domain that are used by the Denodo integration
4. Select “Create”

Assign the Scope to the Asset Types

The next step is to assign the scope to the asset types used by the Denodo integration, that are Database, BI Folder, Table, and Column.

To do so, from the Collibra Platform Settings page:

1. Select “Asset types” from under “Operating Model”
2. Locate and open the “Database” asset type
3. Select “Add assignment” and then locate the newly created scope
4. Select the “Add Assignment” button

Repeat the above steps for the BI Folder, Table, and Column asset types.

Assign the Relations/Attributes to the Asset Types

According to the documentation, the following assignments need to be added:

• For the Database asset type, newly created assignment - the Characteristics section, add the “Database contains BI Folder” relation type.
• For the BI Folder asset type, newly created assignment - the Characteristics section, add the “BI Folder is part of Database” relation type.
• For the Table asset type, newly created assignment - the Characteristics section, add the “URL” attribute type.

Thanks i figured the mistake i made , when i progress further i see the below error

I can see the objects inside collibra, the error appears to me that some complex trype is not getting imported right…

Also with this Integration under which tab would i be able to see the Lineage? I dont see any there

2021-11-16 17:55:11,271 [http-nio-8442-exec-2] TRACE org.springframework.web.method.HandlerMethod - Arguments: [com.collibra.marketplace.library.integration.exception.CollibraIntegrationLibraryException: {“id”:“81d2005b-f492-4a4b-819f-69ae0124a068”,“createdBy”:“00000000-0000-0000-0000-000000900002”,“createdOn”:1637065510630,“lastModifiedBy”:“00000000-0000-0000-0000-000000900002”,“lastModifiedOn”:1637065510991,“system”:false,“resourceType”:“Job”,“name”:“Import”,“type”:“IMPORT”,“userId”:“00000000-0000-0000-0000-000000900002”,“visibility”:0,“progressPercentage”:100,“cancelable”:false,“startDate”:1637065510841,“endDate”:1637065510990,“state”:“ERROR”,“message”:"{“type”:“MESSAGE”,“message”:“An unexpected error occurred during the execution of the job. Please check the log files for more details.”}"}]
2021-11-16 17:55:11,271 [http-nio-8442-exec-2] ERROR com.collibra.marketplace.denodo.exception.GlobalExceptionHandler - Internal error during execution.
com.collibra.marketplace.library.integration.exception.CollibraIntegrationLibraryException: {“id”:“81d2005b-f492-4a4b-819f-69ae0124a068”,“createdBy”:“00000000-0000-0000-0000-000000900002”,“createdOn”:1637065510630,“lastModifiedBy”:“00000000-0000-0000-0000-000000900002”,“lastModifiedOn”:1637065510991,“system”:false,“resourceType”:“Job”,“name”:“Import”,“type”:“IMPORT”,“userId”:“00000000-0000-0000-0000-000000900002”,“visibility”:0,“progressPercentage”:100,“cancelable”:false,“startDate”:1637065510841,“endDate”:1637065510990,"stat

balExceptionHandler’
2021-11-16 17:55:11,270 [http-nio-8442-exec-2] DEBUG org.springframework.web.servlet.mvc.method.annotation.ExceptionHandlerExceptionResolver - Using @ExceptionHandler com.collibra.marketplace.denodo.exception.GlobalExceptionHandler#handleException(Throwable)
2021-11-16 17:55:11,271 [http-nio-8442-exec-2] TRACE org.springframework.web.method.HandlerMethod - Arguments: [com.collibra.marketplace.library.integration.exception.CollibraIntegrationLibraryException: {“id”:“81d2005b-f492-4a4b-819f-69ae0124a068”,“createdBy”:“00000000-0000-0000-0000-000000900002”,“createdOn”:1637065510630,“lastModifiedBy”:“00000000-0000-0000-0000-000000900002”,“lastModifiedOn”:1637065510991,“system”:false,“resourceType”:“Job”,“name”:“Import”,“type”:“IMPORT”,“userId”:“00000000-0000-0000-0000-000000900002”,“visibility”:0,“progressPercentage”:100,“cancelable”:false,“startDate”:1637065510841,“endDate”:1637065510990,“state”:“ERROR”,“message”:"{“type”:“MESSAGE”,“message”:“An unexpected error occurred during the execution of the job. Please check the log files for more details.”}"}]
2021-11-16 17:55:11,271 [http-nio-8442-exec-2] ERROR com.collibra.marketplace.denodo.exception.GlobalExceptionHandler - Internal error during execution.
com.collibra.marketplace.library.integration.exception.CollibraIntegrationLibraryException: {“id”:“81d2005b-f492-4a4b-819f-69ae0124a068”,“createdBy”:“00000000-0000-0000-0000-000000900002”,“createdOn”:1637065510630,“lastModifiedBy”:“00000000-0000-0000-0000-000000900002”,“lastModifiedOn”:1637065510991,“system”:false,“resourceType”:“Job”,“name”:“Import”,“type”:“IMPORT”,“userId”:“00000000-0000-0000-0000-000000900002”,“visibility”:0,“progressPercentage”:100,“cancelable”:false,“startDate”:1637065510841,“endDate”:1637065510990,“state”:“ERROR”,“message”:"{“type”:“MESSAGE”,“message”:“An unexpected error occurred during the execution of the job. Please check the log files for more details.”}"}
at com.collibra.marketplace.library.integration.CollibraImportApiHelper.internalImportComplexRelationsInBatches(CollibraImportApiHelper.java:822) ~[collibra-integration-library-1.0.2.jar:1.0.2]
at com.collibra.marketplace.library.integration.CollibraImportApiHelper.importComplexRelations(CollibraImportApiHelper.java:447) ~[collibra-integration-library-1.0.2.jar:1.0.2]
at com.collibra.marketplace.denodo.service.MainProcessor.start(MainProcessor.java:123) ~[classes/:?]
at com.collibra.marketplace.denodo.controller.EntryPointController.syncTriggeredByApiRequest(EntryPointController.java:79) ~[classes/:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_162]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_162]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_162]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_162]
at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:197) ~[spring-web-5.3.9.jar:5.3.9]
at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:141) ~[spring-web-5.3.9.jar:5.3.9]
at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:106) ~[spring-webmvc-5.3.9.jar:5.3.9]
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895) ~[spring-webmvc-5.3.9.jar:5.3.9]
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808) ~[spring-webmvc-5.3.9.jar:5.3.9]
at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) ~[spring-webmvc-5.3.9.jar:5.3.9]
at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1064) [spring-webmvc-5.3.9.jar:5.3.9]
at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:963) [spring-webmvc-5.3.9.jar:5.3.9]
at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) [spring-webmvc-5.3.9.jar:5.3.9]
at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:909) [spring-webmvc-5.3.9.jar:5.3.9]
at javax.servlet.http.HttpServlet.service(HttpServlet.java:681) [tomcat-embed-core-9.0.50.jar:4.0.FR]
at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) [spring-webmvc-5.3.9.jar:5.3.9]
at javax.servlet.http.HttpServlet.service(HttpServlet.java:764) [tomcat-embed-core-9.0.50.jar:4.0.FR]
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:228) [tomcat-embed-core-9.0.50.jar:9.0.50]
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:163) [tomcat-embed-core-9.0.50.jar:9.0.50]
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) [tomcat-embed-websocket-9.0.50.jar:9.0.50]
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:190) [tomcat-embed-core-9.0.50.jar:9.0.50]
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:163) [tomcat-embed-core-9.0.50.jar:9.0.50]
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:327) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:115) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:81) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:121) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:115) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:126) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:81) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:105) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:149) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilterInternal(BasicAuthenticationFilter.java:178) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.3.9.jar:5.3.9]
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:103) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:89) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.header.HeaderWriterFilter.doHeadersAfter(HeaderWriterFilter.java:90) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:75) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.3.9.jar:5.3.9]
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:110) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:80) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:55) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.3.9.jar:5.3.9]
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:211) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:183) [spring-security-web-5.5.1.jar:5.5.1]
at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) [spring-web-5.3.9.jar:5.3.9]
at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) [spring-web-5.3.9.jar:5.3.9]
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:190) [tomcat-embed-core-9.0.50.jar:9.0.50]
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:163) [tomcat-embed-core-9.0.50.jar:9.0.50]
at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) [spring-web-5.3.9.jar:5.3.9]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.3.9.jar:5.3.9]
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:190) [tomcat-embed-core-9.0.50.jar:9.0.50]
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:163) [tomcat-embed-core-9.0.50.jar:9.0.50]
at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) [spring-web-5.3.9.jar:5.3.9]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.3.9.jar:5.3.9]
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:190) [tomcat-embed-core-9.0.50.jar:9.0.50]
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:163) [tomcat-embed-core-9.0.50.jar:9.0.50]
at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:96) [spring-boot-actuator-2.5.3.jar:2.5.3]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.3.9.jar:5.3.9]
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:190) [tomcat-embed-core-9.0.50.jar:9.0.50]
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:163) [tomcat-embed-core-9.0.50.jar:9.0.50]
at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) [spring-web-5.3.9.jar:5.3.9]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.3.9.jar:5.3.9]
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:190) [tomcat-embed-core-9.0.50.jar:9.0.50]
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:163) [tomcat-embed-core-9.0.50.jar:9.0.50]
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:202) [tomcat-embed-core-9.0.50.jar:9.0.50]
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:97) [tomcat-embed-core-9.0.50.jar:9.0.50]
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:542) [tomcat-embed-core-9.0.50.jar:9.0.50]
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:143) [tomcat-embed-core-9.0.50.jar:9.0.50]
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92) [tomcat-embed-core-9.0.50.jar:9.0.50]
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:78) [tomcat-embed-core-9.0.50.jar:9.0.50]
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:357) [tomcat-embed-core-9.0.50.jar:9.0.50]
at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:382) [tomcat-embed-core-9.0.50.jar:9.0.50]
at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65) [tomcat-embed-core-9.0.50.jar:9.0.50]
at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:893) [tomcat-embed-core-9.0.50.jar:9.0.50]
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1723) [tomcat-embed-core-9.0.50.jar:9.0.50]
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) [tomcat-embed-core-9.0.50.jar:9.0.50]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_162]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_162]
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) [tomcat-embed-core-9.0.50.jar:9.0.50]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_162]
Caused by: com.collibra.internal.exceptions.CollibraJobFailedException: {“id”:“81d2005b-f492-4a4b-819f-69ae0124a068”,“createdBy”:“00000000-0000-0000-0000-000000900002”,“createdOn”:1637065510630,“lastModifiedBy”:“00000000-0000-0000-0000-000000900002”,“lastModifiedOn”:1637065510991,“system”:false,“resourceType”:“Job”,“name”:“Import”,“type”:“IMPORT”,“userId”:“00000000-0000-0000-0000-000000900002”,“visibility”:0,“progressPercentage”:100,“cancelable”:false,“startDate”:1637065510841,“endDate”:1637065510990,“state”:“ERROR”,“message”:"{“type”:“MESSAGE”,“message”:“An unexpected error occurred during the execution of the job. Please check the log files for more details.”}"}
at com.collibra.internal.utils.JobUtils.waitForJobToFinish(JobUtils.java:117) ~[collibra-integration-library-1.0.2.jar:1.0.2]
at com.collibra.internal.utils.JobUtils.monitorJobStatus(JobUtils.java:53) ~[collibra-integration-library-1.0.2.jar:1.0.2]
at com.collibra.internal.logic.ImportOperationsLogic.importJson(ImportOperationsLogic.java:563) ~[collibra-integration-library-1.0.2.jar:1.0.2]
at com.collibra.internal.logic.ImportOperationsLogic.importJsonFromFile(ImportOperationsLogic.java:416) ~[collibra-integration-library-1.0.2.jar:1.0.2]
at com.collibra.internal.logic.UpsertComplexRelationsOperationsLogic.sbUpsertComplexRelationsByName(UpsertComplexRelationsOperationsLogic.java:124) ~[collibra-integration-library-1.0.2.jar:1.0.2]
at com.collibra.marketplace.library.integration.CollibraImportApiHelper$3.attempt(CollibraImportApiHelper.java:848) ~[collibra-integration-library-1.0.2.jar:1.0.2]
at com.collibra.marketplace.library.integration.CollibraImportApiHelper$3.attempt(CollibraImportApiHelper.java:845) ~[collibra-integration-library-1.0.2.jar:1.0.2]
at com.collibra.marketplace.library.integration.InternalSharedLibraryCall.callAndHandle(InternalSharedLibraryCall.java:45) ~[collibra-integration-library-1.0.2.jar:1.0.2]
at com.collibra.marketplace.library.integration.CollibraImportApiHelper.internalImportComplexRelations(CollibraImportApiHelper.java:845) ~[collibra-integration-library-1.0.2.jar:1.0.2]
at com.collibra.marketplace.library.integration.CollibraImportApiHelper.internalImportComplexRelationsInBatches(CollibraImportApiHelper.java:797) ~[collibra-integration-library-1.0.2.jar:1.0.2]
… 95 more
2021-11-16 17:55:11,292 [http-nio-8442-exec-2] DEBUG org.springframework.web.servlet.mvc.method.annotation.HttpEntityMethodProcessor - Found ‘Content-Type:application/json’ in response

Hello Ron,

Thanks for the update.

Regarding this error (“An unexpected error occurred during the execution of the job. Please check the log files for more details.”), can you please provide us with the error message from the Collibra Platform Console logs? This would help in determining what might have caused it.

When using this Denodo integration, the lineage is represented using complex relations. A complex relation is a relation that supports one or more sources/targets and attributes. In this case, as explained in the documentation, the complex relations are between tables or views (i.e. the source/target), while the custom “Dependency Type” attribute value would indicate how the target table/view is created (e.g. Union).

To view the complex relations, a Table asset (created by this integration) should be opened from the domain. Then from the left-hand side, the “Diagram” view should be selected. Subsequently, right-click on the asset from the view and select “Explore”. This would result in a diagram similar to the one under the “Sample Relationship Diagram” section of the Denodo documentation.

Hello Ron,

Thanks for the information provided.

To be able to debug this further, can you please open a support ticket with Collibra Support and provide the Denodo Spring Boot integration debug logs?

I downloaded zip file “sbi-denodo-1.0.1.zip” and imported into eclipse workspace. POM files refers to dependency

com.collibra.marketplace
collibra-integration-library
1.1.0

This cannot be found. Can someone point me where this dependency is available.

Thanks

@spring-team.collibra.com, might you be able to help Rajesh?

Hello Rajesh,

The mentioned dependency is for the the Collibra Spring Boot integration library that is available from this link – https://marketplace.collibra.com/listings/spring-boot-integration-library/. This library is used by the Denodo integration to communicate with the Collibra Platform through its APIs.

Hi @spring-team.collibra.com, would it be possible to make available a .cma archive with the operating model extension?

And is the mockup feature possible to use? The application crashes when called with the X-Use-Mock-Data header

Thanks and have a good week-end!

Hello Arthur,

Attached, please find a CMA file for the Denodo integration. (Please rename the file extension of the attached file from “.txt” to “.cma”)

Regarding, running the Denodo integration using mock data should work. Can you please confirm the following:

• Was the Collibra Platform instance setup according to the documentation (section “Collibra Metamodel“)?
• Was the src/main/java/com/collibra/marketplace/denodo/util/CustomConstants.java class updated with the custom attribute, relation, and custom relation types?
• Were any changes made to the original integration please?

Additionally, can you please provide the error that was thrown by the integration? Thank you

denodo-to-collibra-integration.cma (84.2 KB)

Hello Arthur,

Thanks for the update.

Regarding using Denodo v7 it should work, however, it might need to be confirmed/tested,

Hello Arthur,

To be able to debug this and understand what might be causing this, can you please (1) run the Denodo Spring Boot integration with the log level set to DEBUG and then, (2) open a support ticket with Collibra Support and provide them these logs? Thank you

Indeed @arthur.burkhardt, these items are not (yet) officially supported and this very thread is our current only way of helping customers getting through the weeds on early-bird Spring integrations.

Spring integrations will however mature internally and will be productivized at some point. Then only, will we be able to provide clear SLAs and dedicated support teams for all customers’ questions. Please hang in there and thanks for your comprehension.

Also, FYI, the Denodo CMA file will be added to package this week as all other relevant CMAs in other Spring integrations. Thanks for your highly valued feedbacks!