How to resolve the error HIVE_INVALID_METADATA: Glue table 'ctr-db.11' column 'segmentattributes' has invalid data type: struct<connect\:Subtype:struct<ValueString:string>>

0

I have a CTR data in JSON format stored in s3 bucket which has the below column "SegmentAttributes": { "connect:Subtype": { "ValueString": "connect:Telephony" } } Due to the presence of ":" in "connect:Subtype" I see the below error HIVE_INVALID_METADATA: Glue table 'ctr-db.11' column 'segmentattributes' has invalid data type: struct<connect:Subtype:structValueString:string>

Athena query: SELECT * FROM "ctr-db"."11" limit 10;

How do I resolve the error if I wish to not modify the data? Can I ignore thus column?

1 Answer
0

I think it could be possible rename the struct field in the schema to avoid the issue, the that on that field won't be read but the query should run.

profile pictureAWS
EXPERT
answered 4 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions