Synchronization Activity API

Question

Hi team, i need guidance to track synchronized activity of uploading data from GCP to collibra. Actually after that i want to call one more workflow . So can you please provide code hint for this.

saritawaghmare · Answer

Thank you so much @alvin.useree . I will use this code .

alvinuseree · Answer

Of course @sarita.waghmare !

In the below example, you’ll see I’ve fed the Job Type, State and Name of Sync Job to the jobApi then loop on every result to log the outputs of the sync job

def jobsOfInterest = jobApi.findJobs(FindJobsRequest.builder()
    .types(["IMPORT"])
    .states([JobState.COMPLETED])
    .name("Synchronization of batch for id: f14cfeb2-f1e1-402b-956e-07a7c0e46db4")
    .build()).getResults().each{
    	loggerApi.info(it.getMessage())
    	loggerApi.info("${importerApi.getImportJobSummary(it.getId())}")  
}

Full Code: Example Tracking Sync Info

alvinuseree · Answer

@sarita.waghmare
I think I can be of help here.

Every Synchronisation triggers a Collibra Job with the name:

Synchronization of batch for id: example

(Where example is the id of your sync)

And type: IMPORT

You can track this information by calling the JobApi with the type parameter as IMPORT.

For GCP I imagine you’ve appropriately named the ingestion to be able to easily identify it.

The cool thing here is that a sync (irrespective of how it was triggered - jobserver, edge, apis etc) is just an Import.

This means you can grab the results metadata programmatically using the Import Results endpoint!

1	Grant Rollerson SUNCORP CORPORATE SERVICES PTY LTD
2	Tom Friesen Algonquin College
3	SB S Benson Plus3 IT
4	S stefan_busch
5	Brian Lloyd USA TODAY Co.
6	D daverichard