H

Wednesday, August 4th, 2021 4:37 PM

Question on JSON data quality capability and Data set filter for analysis

Two subjects :

  • Is it possible to create a rule that will analyse the content of a Json located in a field?
  • Is it possible to filter a dataset to analyse it. For instance I have a rule that apply to a dataset containing data on several products, is it possible to filter only on one product and see the data quality result only for this product (without creating a new dataset)?

41 Messages

4 years ago

  1. JSON file = yes
  2. a single JSON column from a database as blob or clob or json possibly if its the only column
  3. MongoDB document json object yes if the proper drivers
  4. What isn’t supported is a JSON column in a database table with other columns, because you technically have 2 schemas the database table schema and the json schema.

So while you can write rules or have auto rules on JSON you cannot mix JSON with tabular data

As for filtering a dataset you could do a couple things, 1) apply where clause in the original -q “select” or 2) apply a rule condition like “where col1=A and col2 > 5”

Loading...