Processing Volume Q: Do You Scan Every Row? How To Handle ~2TB? A: Yes, We Define Agent To Send Compute; Work With Available Hardware; Could Be Databricks, Spark Cluster, Other Endpoint Q: If Customers Spin Up 1TB RAM, Do You Often Run Into Tables Larger Than That? A: Typically If They Have Larger Datasets, They Have Something To Point To Q: Is There Plan To Have Number Of Agents And Load Balancers For Large Jobs? A: Customers Can Carve Multiple Agents To Send To HDFS-Backed; Load Balancer Is Fu...

Technical: Processing Volume / Hardware Recommendations | Data Quality & Observability

Technical: Processing Volume / Hardware Recommendations | Data Quality & Observability | Collibra Community