Power BI Lineage Harvesting via Edge Capability Error

Hi Team,

We are trying to extract Technical Lineage from Power BI using Collibra Edge capability as per below documentation:
https://productresources.collibra.com/docs/collibra/latest/Content/CollibraDataLineage/PowerBI2.0/PowerBI-via-Edge/co_techlin-power-bi-via-edge.htm

But we are facing below error:

2023-03-13 04:25:38.906 [pool-30-thread-1] ERROR c.c.c.c.i.c.j.i.EdgeJobStateListener - Synchronization job on edge with id: b5cb9f2e-7171-486c-baf9-xxxxxxxxxxxx failed with message: {“finalStatus”:“FAILED”,“startTime”:1678694914000,“endTime”:1678694951000,“ingestionReport”:{“messages”:[“harvester.error.ProcessingError: Unclassified Harvester error: 1 errors during loading sources: harvester.error.SourceProcessingError: sttp.client3.SttpClientException$TimeoutException: Exception when sending request: GET https://login.microsoftonline.com/833ff98c-339d-410f-ad62-xxxxxxxxxxxx%2F.well-known%2Fopenid-configuration"]},“extraFields”:[{“label”:"Site ID”,“value”:“2fc001d0-aec0-4fc2-89de-xxxxxxxxxxxx”},{“label”:“System ID”,“value”:“331d9390-7134-4b90-849a-xxxxxxxxxxxx”},{“label”:“Job ID”,“value”:“b5cb9f2e-7171-486c-baf9-xxxxxxxxxxxx”}]}. []
2023-03-13 04:25:38.906 [pool-30-thread-1] WARN c.c.c.c.i.c.j.i.SynchronizationJobStateManagerImpl - Synchronization job : SynchronizationCloudJob(jobStatus=FAILED, progress=100.0, message={“finalStatus”:“FAILED”,“startTime”:1678694914000,“endTime”:1678694951000,“ingestionReport”:{“messages”:[“harvester.error.ProcessingError: Unclassified Harvester error: 1 errors during loading sources: harvester.error.SourceProcessingError: sttp.client3.SttpClientException$TimeoutException: Exception when sending request: GET https://login.microsoftonline.com/833ff98c-339d-410f-ad62-xxxxxxxxxxxx%2F.well-known%2Fopenid-configuration"]},“extraFields”:[{“label”:"Site ID”,“value”:“2fc001d0-aec0-4fc2-89de-xxxxxxxxxxxx”},{“label”:“System ID”,“value”:“331d9390-7134-4b90-849a-xxxxxxxxxxxx”},{“label”:“Job ID”,“value”:“b5cb9f2e-7171-486c-baf9-xxxxxxxxxxxx”}]}, telemetryTracker=POWERBI_HARVESTER) failed with state: SynchronizationCloudJob(jobStatus=FAILED, progress=100.0, message={“finalStatus”:“FAILED”,“startTime”:1678694914000,“endTime”:1678694951000,“ingestionReport”:{“messages”:[“harvester.error.ProcessingError: Unclassified Harvester error: 1 errors during loading sources: harvester.error.SourceProcessingError: sttp.client3.SttpClientException$TimeoutException: Exception when sending request: GET https://login.microsoftonline.com/833ff98c-339d-410f-ad62-xxxxxxxxxxxx%2F.well-known%2Fopenid-configuration"]},“extraFields”:[{“label”:"Site ID”,“value”:“2fc001d0-aec0-4fc2-89de-xxxxxxxxxxxx”},{“label”:“System ID”,“value”:“331d9390-7134-4b90-849a-xxxxxxxxxxxx”},{“label”:“Job ID”,“value”:“b5cb9f2e-7171-486c-baf9-xxxxxxxxxxxx”}]}, telemetryTracker=POWERBI_HARVESTER). []

Can someone tell us why we are facing this above issue?

We are trying to troubleshoot this and found below documentation:

https://productresources.collibra.com/docs/collibra/latest/Content/CollibraDataLineage/PowerBI2.0/Prerequisites/co_power-bi-considerations-and-limitations.htm

As per the documentation it is said:

Ensure that the lineage harvester can connect to the following URLs:
- https://login.microsoftonline.com:443
- https://api.powerbi.com:443
- The URL of your Power BI tenant, which you have to specify in the tenantDomain property of your lineage harvester configuration file.

If this is something that is causing us the issue then, How to check these connections are working from Edge Site?

krishnachaitanya_p

Posted 3 years ago · Edited 1 year ago·Last reply 3 years ago

6 comments

krishnachaitanya_p

OP3 years ago · Edited

Thankyou @anouk.gorris!

anoukgorris

·3 years ago · Edited

Hi @krishna.chaitanya.p, please create a Collibra or Microsoft support ticket to help you connect to Power BI.

krishnachaitanya_p

OP3 years ago · Edited

Hi @anouk.gorris, Just sending to make sure if you saw the above comment of mine.

krishnachaitanya_p

OP3 years ago · Edited

Hi @anouk.gorris,

We have followed all the steps as mentioned in the documentation that you provided.

More over the issue is same for both Technical Lineage via Edge as well as Lineage Harvester. Lineage harvester and Edge are on same Linux machine. I tried ping command and it did not reach requied URLs as mentioned in initial post. Any specific commands can you tell me to verify this?

Thank you!

anoukgorris

·3 years ago · Edited

Hi @krishna.chaitanya.p,
You have to allow the connection to these urls to be able to connect Edge to Power BI.
Other than that, not having the correct permissions and configuration in Power BI results in the same: https://productresources.collibra.com/docs/collibra/latest/Content/CollibraDataLineage/PowerBI2.0/Prerequisites/ta_register-power-bi-in-azure.htm

If your connection succeeded via lineage harvester, but fails via Edge, something is most likely blocking the connection between Edge and Power BI.

krishnachaitanya_p

OP3 years ago · Edited

Hi @anouk.gorris - Can you please help us? Thanks in advance.