How to resolve the error HIVE_INVALID_METADATA: Glue table 'ctr-db.11' column 'segmentattributes' has invalid data type: struct

Question

I have a CTR data in JSON format stored in s3 bucket which has the below column 
"SegmentAttributes": {
        "connect:Subtype": {
            "ValueString": "connect:Telephony"
        }
    }
Due to the presence of ":" in "connect:Subtype" I see the below error
HIVE_INVALID_METADATA: Glue table 'ctr-db.11' column 'segmentattributes' has invalid data type: struct>

Athena query:
SELECT * FROM "ctr-db"."11" limit 10;

How do I resolve the error if I wish to not modify the data? Can I ignore thus column?

Answer

I think it could be possible rename the struct field in the schema to avoid the issue, the that on that field won't be read but the query should run.

How to resolve the error HIVE_INVALID_METADATA: Glue table 'ctr-db.11' column 'segmentattributes' has invalid data type: struct<connect\:Subtype:struct<ValueString:string>>

相关内容