DQ and BigQuery - Nested fields (structs, arrays)
Customer question: Are there any plans to support nested fields in BigQuery (array is not supported right now) and make the structs representation more user friendly?
Answer from Brian Mearns:
“At this time any nested, explode, flatten functionality is best handled by the JDBC interface layer and underlying database. We have NO intentions to work on auto-unpacking the various nested levels of structs, maps, arrays during 2022 Q3 or Q4.”
BigDataBear
Posted 4 years ago · Edited 1 year ago·Last reply 1 year ago
1 comment
Brian Lloyd
·1 year agoThis is a fundamental need for anyone using BigQuery. There is an Ideation that should be Up Voted here: Technical Lineage supporting BigQuery Nested | Ideation platformI know it says Lineage, but I believe it should apply to Cataloging as well.