Maximum Amount of Rest API Call
Hello Dear Data Citizens,
does someone know if there is a limit to how much calls you can, or should, do per minute / second to the rest api?
Background is I need information about the relations of a lot of assets and unfortunately one does not get this information with the find asset endpoint, so I need to call the relations endpoint per asset.
Sincerely,
Stefan
stefan_busch
Posted 3 years ago · Edited 1 year ago·Last reply 3 years ago
4 comments
stefan_busch
OP3 years ago · Edited@clark.lawson @tom.kuppens.telenetgroup.be @arthur.burkhardt thank you all for your valuable input
arthurburkhardt
·3 years ago · Edited+1 for @tom.kuppens.telenetgroup.be, outputmodule is definitely the way to go.
)
https://developer.collibra.com/rest/output-module (Hey, the developer documentation portal has been updated!
One cool trick: you can create a view in collibra as the basis of your output module query, by calling the
/rest/2.0 /outputModule/tableViewConfigs/viewId/{viewId}endpoint.You can also use the asset grid to create a query, but it will be retired, so…
tomkuppens1
·3 years ago · EditedHey Stefan,
my go-to is the Output Module, when I need bulk data of assets. Better performance.
Once you understand the process, you could also actually just write your own TableviewConfigs - it’s just an elaborate json query against Collibra.
Tom
clarklawson
·3 years ago · EditedHello @stefan.busch,
I found that there are no limits to the number of requests per minute if your requests are done in series.
When I attempted to use asyncio, then the server became too busy.
I had a similar problem to you when I wanted to query a lot of assets and their associated relationships. I would double check that you can’t filter by relationship type using the relationship endpoint and then process to get the assets you wish.