Collibra DQ API to export all error records with rule details

Question

Currently we are using
DQ API : /v2/get-rule-with-details
Request Method: GET

but we are only able to export 6 records per rule breaks.

Also we are trying with the -linkId in our commandline API and triggered API : /v2/getrulebreaks, but it seems that the result is not coming up.

Is there any handy REST API that can provide details of all the error records along with the rules it has failed?

George Luft · Answer

You can also modify the preview limit beyond the default of 6—and the UI maximum of 50–using the /v2/getrules and /v2/createrule API calls. Please note that keeping large numbers of breaking records may affect job performance, metastore size, or even data retention policy. Verify that you have the latest release equal or more recent than v 2022.01 Add the rule as you normally would in the Rule Builder and put a value less than 50 in the Preview Limit (Rows). Save the Rule. Go into the ADMIN -> API then SWAGGER REST API’s In the top Right hand corner Select UI Internal for Definition Under the CONTROLLER-RULE section goto /v2/getrules Click on the TryItOut button and enter in the information and select Execute Copy the output information to be entered in the next section Goto POST /v2/createrule and enter the data you just got from the previous API Call CHANGE THE Preview Limit to whatever you want* ***** The more you make this the longer the jobs will take as it adds processing time Run the DQ Job in the UI and you should be able to now see the amount of rows you had requested.

henrytram · Answer

@mayukh.das.ulta.com These two v3 APIs work to fetch all broken records by job or dataset.

henrytram · Answer

@mayukh.das.ulta.com These two v3 APIs work to fetch all broken records by job or dataset.

1	Grant Rollerson SUNCORP CORPORATE SERVICES PTY LTD
2	Tom Friesen Algonquin College
3	SB S Benson Plus3 IT
4	S stefan_busch
5	Brian Lloyd USA TODAY Co.
6	D daverichard