How to skip a specific row in a remote CSV file source from processing since it is malformed

Have a DQ job to be created on remote ADLS file CSV file with delimiter '~'. The file throws an error ' trailing quote on quoted field is malformed in row 79' and hence a blocker.

How to address this issue?

Can we skip the row 79 alone from processing?

Tried skip lines options, but it skips the headers too.. wanted the headers and the valid 77 rows as well.

How to tackle this ?

Thanks in advance

hyoosaf

Posted 2 years ago · Edited 1 year ago·Last reply 2 years ago

1 comment

2 years ago

Hi there,

This is Lauren from the Collibra Community team. Thank you for posting these questions. We've reached out to some folks at Collibra to help answer your question.

While we wait for someone with specific experience in this area to respond, we invite you to browse a few resources that might help:

Collibra Documentation
Community Resources
Community Leaders - we are all here to help each other. Feel free to contact a fellow Community member directly with your question.

We appreciate your patience and hope to see this resolved soon.

Best,

Lauren

Community Team