Hello Fellow Data Citizens, I hope you are well! I have read that Spark-Submit is an available option to execute CollibraDQ jobs. However, It has some limitations. Can I please request more clarification/information. Thank you. Spark-Submit path is not supported in Production by Collibra support team CollibraDQ team is not supporting any bug fix Each Spark-Submit job requires a new Spark Cluster.

Limitations of Spark-Submit jobs for CollibraDQ | Data Quality & Observability

Limitations of Spark-Submit jobs for CollibraDQ | Data Quality & Observability | Collibra Community