Collibra technical lineage 1.4.0 -
Hi everybody,
While running the lineage harvester master batch “lineage harvester syc -s source1 -s source2”, the master match is running for some time, then it fails with below error. 9 out of 10 times it fails with this error, 1 time completes successfully - no data changed between runs.
Any idea what could be and how to fix it? Seems like a connection issue between Techlin and DGC.
2021-07-23T16:34:46Z [scala-execution-context-global-117] ERROR harvester.AbstractHarvester - ShowcaseClientError:
PROCESSING ERROR: “HttpServerError: Received ‘500 Internal Server Error’ response code to POST https://adobe.collibra.com/rest/catalog/1.0/internal/technicalLineage/relations/importRelations request. Server error after 5 tries. Response body:
{“statusCode”:500}”
Full error message: Received ‘410 Gone’ response code to GET https://techlin-aws-us.collibra.com/api/batch/dd9716a7-eea3-4351-a17a-431f8cbae488/status/ request. Response body:
{“slug”: “dd9716a7-eea3-4351-a17a-431f8cbae488”, “status”: “failed”, “message”: “PROCESSING ERROR: “HttpServerError: Received ‘500 Internal Server Error’ response code to POST https://adobe.collibra.com/rest/catalog/1.0/internal/technicalLineage/relations/importRelations request. Server error after 5 tries. Response body:\n{“statusCode”:500}””}
Raised support cases with Collibra with no luck. We have another env where we sync the same lineage data, but there it is working fine.
Thanks,
Alex
alvinuseree
·5 years ago · EditedI think Collibra Support/Professional Services is your best bet to help debug/resolve your issue. I find that unless the issue is really obvious, connection issues are quite difficult to resolve outside of a call/ technical deep dive.
Two things I would try though (and might help you on your path to resolution with support/professional services):
test-connectionparameter and see if the test connection works