AWS Lake Formation Bidirectional Colibra Integration- LF Tags and Bi Directional Integration
HI @spring-team.collibra.com team
Here is a little background on the implementation done so far and where we are stuck at. We have implemented AWS Lake Formation BiDirectional integration. All the related configurations etc. are done and we are able to fetch the Catalog details and mainly the metadata part for few of the databases in the catalog and not all of them. So thats our first issue.
The second issue is the LF Tags. At this moment despite all the configurations done, we are not able to bring in the LF Tags into Collibra. I’m attaching some snapshots for reference.
So to be clearer in terms of IAM Roles etc., please help with few more questions:
- What IAM Policies we need to provide it to the COllibra User so that its able to get the LF Tags info.
- At AWS Lake Formation, what IAM Role permissions at each DB level we need to have so that all the DB level metadata gets imported into COllibra
- Lastly at Lake Formation LF-Tags Permission what permissions needs to be provided to the COllibra User.
Please help us to get these resolved as these are impacting the Go Live timelines.Issue-LFTAGS.docx (887.0 KB)
mohammadsufiyan_ansari
OP2 years ago · Edited@ Kristen Freer
@spring-team.collibra.com
@leo.desapires
Quick update , I have been able to resolve the issues which were coming because of the IAM role not been given proper privileges. Now I’m having issues with AWS Workflows for Creating New LF Tag Key. Its erroring out because its not able to find the corresponding Asset id “The asset type ‘b7501afb-cf9d-4a08-81b9-324354f47cc3’ cannot be found.”
The asset id in DGC is Aws-Create-Tag ->0b518989-0a7f-45dc-a595-f15c190b2694 which does not match with what the Workflow expects it to be.
I have imported the CMS file which was at the location “src\main\resources\collibra_exports\AWS_Lake_Formation.cma” as this was the one which was not erroring out during the import. .
I relaized that there is another CMA file “src\main\resources\sbiLakeFormation.cma” which is giving error while import as “File sbiLakeFormation.cma simulation failed The argument(s) ‘RelationTypeDirection’ are invalid.”. This one seems to be the correct one but I’m not able to import it.
Is there any package with proper CMA file intact? Once I’m able to have the proper CMA file then I believe the issue will get resolved.
Please suggest
mohammadsufiyan_ansari
OP2 years ago · EditedTagging @ Kristen Freer to help us out here
mohammadsufiyan_ansari
OP2 years ago · EditedHi Team
Any suggestions???