Azure Purview Springboot integration

Hi Arthur,

The Azure Purview Marketplace integration is not tied down to a specific Operating Model. Relation and Attribute types are all configurable. Some Asset Types are also configurable. Moreover, we cannot create a general assignment of attributes, because attributes used on the different type of assets depend on the fields returned by your specific Purview instance. Therefore, we cannot create a generic .cma file.

There seems to be some issues with the integration.

1. Upon running, I get a NullPointerException

2022-02-10 18:02:50,945 [http-nio-8443-exec-1] INFO  com.collibra.marketplace.azure.purview.component.CollibraGenericImportComponent - Import Job completed for Job ID:: 4a56f0e9-b6e5-42fa-91b6-13ab21dbf304
2022-02-10 18:02:50,949 [http-nio-8443-exec-1] INFO  com.collibra.marketplace.azure.purview.FullSyncProcessor - Domains upsert completed
2022-02-10 18:02:50,968 [http-nio-8443-exec-1] DEBUG com.collibra.marketplace.azure.purview.FullSyncProcessor - Domains Upsert Response :: {}["{\"type\":\"IMPORT\"}"]
java.lang.NullPointerException
        at com.collibra.marketplace.azure.purview.component.AzurePurviewSearchComponent.searchEntityFull(AzurePurviewSearchComponent.java:167)
        at com.collibra.marketplace.azure.purview.component.AzurePurviewSearchComponent.searchEntityFull(AzurePurviewSearchComponent.java:133)
        at com.collibra.marketplace.azure.purview.component.AzurePurviewSearchComponent.searchEntity(AzurePurviewSearchComponent.java:111)
        at com.collibra.marketplace.azure.purview.FullSyncProcessor.start(FullSyncProcessor.java:347)
        at com.collibra.marketplace.azure.purview.controller.EntryPointController.fullSyncTriggeredByApiRequest(EntryPointController.java:64)

2. In the documentation, there seems to be a mix up with the talend spring-boot integration.

Can you please help, @spring-team.collibra.com ?

Hi Arthur ,

Since you have already done this in your env and I am planning to do it in our instance :

How the code is handling the refresh of metadata saying that I meant if any change is done in the source like adding , editing , deleting of the entities in azure side will that be auto sync in Collibra with the Market place solution or do we need to enhance the code .

Your help will be appreciated .

Warm Regards,
Rohit

Hi All,

I would need your help on the below error , I am getting connection timeout error using the spring boot sbi-azurepurview to collibra :

2022-05-04 10:53:12,728 [RMI TCP Connection(3)-127.0.0.1] INFO org.springframework.web.servlet.DispatcherServlet - Completed initialization in 1 ms
2022-05-04 10:53:16,347 [http-nio-8081-exec-1] WARN org.apache.catalina.util.SessionIdGeneratorBase - Creation of SecureRandom instance for session ID generation using [SHA1PRNG] took [225] milliseconds.
2022-05-04 10:53:16,372 [http-nio-8081-exec-1] INFO com.collibra.marketplace.azure.purview.controller.EntryPointController - Integration triggered via API request for full sync
2022-05-04 10:53:16,373 [http-nio-8081-exec-1] INFO com.collibra.marketplace.azure.purview.FullSyncProcessor - Started Purview full sync
2022-05-04 10:53:16,373 [http-nio-8081-exec-1] INFO com.collibra.marketplace.azure.purview.component.CollibraCoreAPIComponent - Removing all mappings with external system id azure_purview …
org.springframework.web.client.ResourceAccessException: I/O error on POST request for : Connection timed out: connect; nested exception is java.net.ConnectException: Connection timed out: connect
at org.springframework.web.client.RestTemplate.doExecute(RestTemplate.java:785)
at org.springframework.web.client.RestTemplate.execute(RestTemplate.java:711)
at org.springframework.web.client.RestTemplate.exchange(RestTemplate.java:602)
at com.collibra.marketplace.azure.purview.component.CollibraCoreAPIComponent.removeMappings(CollibraCoreAPIComponent.java:171)
at com.collibra.marketplace.azure.purview.FullSyncProcessor.start(FullSyncProcessor.java:461)

Hi Arthur,

I will help . Thanks a lot.

Warm Regards,
Rohit Chandra