Can we reference a prior run of a DQ Job when writing a rule?
I know we can reference datasets in a custom rule but a customer has asked whether than can refer to a specified prior run of a job against that dataset for a rule. For example a rule that checks the row count of the current run against the row count of a specific prior run.
dylanglenn
Posted 4 years ago · Edited 1 year ago·Last reply 1 year ago
2 comments
ericgerstner
·4 years ago · EditedGetting historical state of the same dataset Syntax: @t , where n parameter means, how many days should we go back in the past at the base dataset (marked with @<dataset_name>) Example:
@t1 , will point to the data which was used at yesterday’s run
@t4 , will point to the data which was used 4 days ago
https://dq-docs.collibra.com/dq-job-examples/data-quality-pipelines/owl-rules-dq-pipeline/sql-based-rules/freeform-sql#where-style
Saurabh Mudgal
·1 year ago · EditedI have similar requirements where I need to create rule and use last week count to get average count to process rule , but above link is broken. Can anyone please help?