3 Messages
Run bulk numbers of rows in less time in CDQ
Hi All,
I am trying to run a dq job which has around 30,00,00,000+ rows and around 200+ columns. I did run the dataset with this data and it took me almost 4hrs to execute. Is there any option which Collibra DQ provides by which i can run these rows in batch wise (100000) per run with all 200+columns in a single go. I tried limit the rows option but i am not sure if it run the profiling on new rows for each run.
No Responses!