Denodo-Collibra integration was working fine until last week but after recent upgrade of Collibra DIC (2023.03) it stopped working.
Denodo-Collibra integration was working fine until last week but after recent upgrade of Collibra DIC (2023.03) it stopped working.
We are using the following releases for the integration:
- Spring Boot framework v2.7.5
- Java 17.0.5
- Collibra Integration Library 1.1.10
- Denodo to Collibra Integration(Spring boot integration template) v1.1.1
We faced version compatibility issues earlier and had to downgrade Collibra Integration Library (CIL) to 1.1.10 to make the integration work but currently none of the available releases 1.1.10, 1.2.0, 1.2.1 & 1.2.2 are working.
Error messages are different for different CIL releases. Below logs are shared for reference.
v1.1.10 error log
2023-03-10 02:23:01,772 [scheduling-1] INFO com.zaxxer.hikari.HikariDataSource - HikariPool-2 - Start completed.
2023-03-10 02:23:03,299 [scheduling-1] INFO com.collibra.marketplace.denodo.component.DenodoSource - Retrieved the metadata from Denodo.
2023-03-10 02:23:03,330 [scheduling-1] INFO com.collibra.marketplace.denodo.component.CollibraAssetTransformer - Transforming the assets…
2023-03-10 02:23:03,656 [scheduling-1] INFO com.collibra.marketplace.denodo.component.CollibraAssetTransformer - Transformed all assets.
2023-03-10 02:23:03,658 [scheduling-1] INFO com.collibra.marketplace.denodo.service.IntegrationService - Importing the 654 assets and 1 complex relations…
2023-03-10 02:23:04,040 [scheduling-1] INFO com.collibra.marketplace.library.integration.InternalSharedLibraryConnection - Authenticating with the Collibra Platform…
2023-03-10 02:23:04,364 [scheduling-1] INFO com.collibra.marketplace.library.integration.InternalSharedLibraryConnection - Successfully authenticated with the Collibra Platform.
2023-03-10 02:23:04,365 [scheduling-1] WARN com.collibra.marketplace.library.integration.InternalSharedLibraryCall - Retrying internal call to the Collibra Platform. Attempt 1 of 1.
2023-03-10 02:23:05,401 [scheduling-1] ERROR org.springframework.scheduling.support.TaskUtils$LoggingErrorHandler - Unexpected error occurred in scheduled task
com.collibra.marketplace.library.integration.exception.CollibraIntegrationLibraryException: {“message”:“An unexpected error occurred during execution.”,“details”:“The request to the Collibra Platform instance failed. It was retried 1 times.”}
at com.collibra.marketplace.library.integration.CollibraImportApiHelper.internalImportAssetsInBatches(CollibraImportApiHelper.java:582) ~[collibra-integration-library-1.1.10.jar:1.1.10]
at com.collibra.marketplace.library.integration.CollibraImportApiHelper.importAssets(CollibraImportApiHelper.java:116) ~[collibra-integration-library-1.1.10.jar:1.1.10]
at com.collibra.marketplace.denodo.service.IntegrationService.start(IntegrationService.java:64) ~[classes/:?]
at com.collibra.marketplace.denodo.processor.ScheduledProcessor.syncTriggeredByCronScheduler(ScheduledProcessor.java:34) ~[classes/:?]
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?]
at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?]
at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) ~[spring-context-5.3.23.jar:5.3.23]
at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) ~[spring-context-5.3.23.jar:5.3.23]
at org.springframework.scheduling.concurrent.ReschedulingRunnable.run(ReschedulingRunnable.java:95) ~[spring-context-5.3.23.jar:5.3.23]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) ~[?:?]
at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?]
at java.lang.Thread.run(Thread.java:833) ~[?:?]
Caused by: com.collibra.marketplace.library.integration.exception.CollibraIntegrationLibraryException: {“message”:“An unexpected error occurred during execution.”,“details”:“The request to the Collibra Platform instance failed. It was retried 1 times.”}
at com.collibra.marketplace.library.integration.CollibraImportApiHelper.internalImportAssets(CollibraImportApiHelper.java:688) ~[collibra-integration-library-1.1.10.jar:1.1.10]
at com.collibra.marketplace.library.integration.CollibraImportApiHelper.internalImportAssetsInBatches(CollibraImportApiHelper.java:571) ~[collibra-integration-library-1.1.10.jar:1.1.10]
… 16 more
Caused by: com.collibra.marketplace.library.integration.exception.CollibraIntegrationLibraryException: {“message”:“An unexpected error occurred during execution.”,“details”:“The request to the Collibra Platform instance failed. It was retried 1 times.”}
at com.collibra.marketplace.library.integration.InternalCollibraLibraryExceptionMapper.logAndRethrowException(InternalCollibraLibraryExceptionMapper.java:86) ~[collibra-integration-library-1.1.10.jar:1.1.10]
at com.collibra.marketplace.library.integration.CollibraImportApiHelper.internalImportAssets(CollibraImportApiHelper.java:665) ~[collibra-integration-library-1.1.10.jar:1.1.10]
at com.collibra.marketplace.library.integration.CollibraImportApiHelper.internalImportAssetsInBatches(CollibraImportApiHelper.java:571) ~[collibra-integration-library-1.1.10.jar:1.1.10]
… 16 more
Caused by: com.collibra.marketplace.library.integration.exception.CollibraIntegrationLibraryException: The request to the Collibra Platform instance failed. It was retried 1 times.
at com.collibra.marketplace.library.integration.InternalSharedLibraryCall.callAndHandle(InternalSharedLibraryCall.java:59) ~[collibra-integration-library-1.1.10.jar:1.1.10]
at com.collibra.marketplace.library.integration.InternalImportAssetsUtil.exportAssets(InternalImportAssetsUtil.java:259) ~[collibra-integration-library-1.1.10.jar:1.1.10]
at com.collibra.marketplace.library.integration.CollibraImportApiHelper.internalImportAssets(CollibraImportApiHelper.java:609) ~[collibra-integration-library-1.1.10.jar:1.1.10]
at com.collibra.marketplace.library.integration.CollibraImportApiHelper.internalImportAssetsInBatches(CollibraImportApiHelper.java:571) ~[collibra-integration-library-1.1.10.jar:1.1.10]
… 16 more
v1.2.2 error log
2023-03-10 02:19:00,004 [scheduling-1] INFO com.collibra.marketplace.denodo.processor.ScheduledProcessor - Synchronization triggered via CRON Scheduler
2023-03-10 02:19:00,013 [scheduling-1] INFO com.collibra.marketplace.denodo.service.IntegrationService - Started synchronizing the metadata
2023-03-10 02:19:00,045 [scheduling-1] INFO com.collibra.marketplace.denodo.component.DenodoSource - Retrieving the metadata from Denodo…
2023-03-10 02:19:00,307 [scheduling-1] INFO com.zaxxer.hikari.HikariDataSource - HikariPool-2 - Starting…
2023-03-10 02:19:00,309 [scheduling-1] WARN com.zaxxer.hikari.util.DriverDataSource - Registered driver with driverClassName=com.denodo.vdp.jdbc.Driver was not found, trying direct instantiation.
2023-03-10 02:19:01,931 [scheduling-1] INFO com.zaxxer.hikari.pool.PoolBase - HikariPool-2 - Driver does not support get/set network timeout for connections. (null)
2023-03-10 02:19:02,084 [scheduling-1] INFO com.zaxxer.hikari.HikariDataSource - HikariPool-2 - Start completed.
2023-03-10 02:19:03,769 [scheduling-1] INFO com.collibra.marketplace.denodo.component.DenodoSource - Retrieved the metadata from Denodo.
2023-03-10 02:19:03,771 [scheduling-1] INFO com.collibra.marketplace.denodo.component.CollibraAssetTransformer - Transforming the assets…
2023-03-10 02:19:03,880 [scheduling-1] INFO com.collibra.marketplace.denodo.component.CollibraAssetTransformer - Transformed all assets.
2023-03-10 02:19:03,885 [scheduling-1] INFO com.collibra.marketplace.denodo.service.IntegrationService - Importing the 654 assets and 1 complex relations…
2023-03-10 02:19:03,911 [scheduling-1] ERROR org.springframework.scheduling.support.TaskUtils$LoggingErrorHandler - Unexpected error occurred in scheduled task
com.collibra.marketplace.library.integration.exception.CollibraIntegrationLibraryException: Cannot invoke “java.util.Map.get(Object)” because “this.importResponses” is null
at com.collibra.marketplace.library.integration.CollibraImportApiHelper.internalImportAssetsInBatches(CollibraImportApiHelper.java:663) ~[collibra-integration-library-1.2.2.jar:1.2.2]
at com.collibra.marketplace.library.integration.CollibraImportApiHelper.importAssets(CollibraImportApiHelper.java:150) ~[collibra-integration-library-1.2.2.jar:1.2.2]
at com.collibra.marketplace.denodo.service.IntegrationService.start(IntegrationService.java:64) ~[classes/:?]
at com.collibra.marketplace.denodo.processor.ScheduledProcessor.syncTriggeredByCronScheduler(ScheduledProcessor.java:34) ~[classes/:?]
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?]
at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?]
at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) ~[spring-context-5.3.23.jar:5.3.23]
at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) ~[spring-context-5.3.23.jar:5.3.23]
at org.springframework.scheduling.concurrent.ReschedulingRunnable.run(ReschedulingRunnable.java:95) ~[spring-context-5.3.23.jar:5.3.23]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) ~[?:?]
at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?]
at java.lang.Thread.run(Thread.java:833) ~[?:?]
Caused by: com.collibra.marketplace.library.integration.exception.CollibraIntegrationLibraryException: Cannot invoke “java.util.Map.get(Object)” because “this.importResponses” is null
at com.collibra.marketplace.library.integration.CollibraImportApiHelper.internalImportAssets(CollibraImportApiHelper.java:770) ~[collibra-integration-library-1.2.2.jar:1.2.2]
at com.collibra.marketplace.library.integration.CollibraImportApiHelper.internalImportAssetsInBatches(CollibraImportApiHelper.java:651) ~[collibra-integration-library-1.2.2.jar:1.2.2]
… 16 more
Caused by: com.collibra.marketplace.library.integration.exception.CollibraIntegrationLibraryException: Cannot invoke “java.util.Map.get(Object)” because “this.importResponses” is null
at com.collibra.marketplace.library.integration.CollibraImportApiHelper.internalGetOrInitializeResponseJsonNode(CollibraImportApiHelper.java:579) ~[collibra-integration-library-1.2.2.jar:1.2.2]
at com.collibra.marketplace.library.integration.CollibraImportApiHelper.internalImportAssets(CollibraImportApiHelper.java:677) ~[collibra-integration-library-1.2.2.jar:1.2.2]
at com.collibra.marketplace.library.integration.CollibraImportApiHelper.internalImportAssetsInBatches(CollibraImportApiHelper.java:651) ~[collibra-integration-library-1.2.2.jar:1.2.2]
… 16 more
Caused by: java.lang.NullPointerException: Cannot invoke “java.util.Map.get(Object)” because “this.importResponses” is null
at com.collibra.marketplace.library.integration.CollibraImportApiHelper.internalGetOrInitializeResponseJsonNode(CollibraImportApiHelper.java:565) ~[collibra-integration-library-1.2.2.jar:1.2.2]
at com.collibra.marketplace.library.integration.CollibraImportApiHelper.internalImportAssets(CollibraImportApiHelper.java:677) ~[collibra-integration-library-1.2.2.jar:1.2.2]
at com.collibra.marketplace.library.integration.CollibraImportApiHelper.internalImportAssetsInBatches(CollibraImportApiHelper.java:651) ~[collibra-integration-library-1.2.2.jar:1.2.2]
… 16 more
Nigel Goldsmith
·3 years ago · EditedHi Abhijith,
did you find a resolution to this ?
If not, I’d suggest you open a ticket with support.
thanks
[email protected]