Hi Team, We have a S3 bucket that has same files loaded with different timestamps. When we register the system in Collibra the driver pulls all the files. The issue is that duplicate instances of the same files are getting loaded into Collibra. Can anyone suggest a better practice to ingest the S3 file since the user need to see the schema of S3 file and having only one instance of the file ingested should work, any thoughts ? Thank You Rahul

Looking for better way to Catalog S3 metadata | Developers

Looking for better way to Catalog S3 metadata | Developers | Collibra Community