By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

error message when loading data: GENERIC_INTERNAL_ERROR: No enum constant org.apache.parquet.schema.OriginalType.2a

0

Hi, I'm trying to load data from s3 to s3 in my current work. The source data has all fields in string data format whereas the destination has the right field formats (decimal, date etc). I can run the select command in the source data (with all the transformations) but when I put insert into statement to load data to another schema I get the error message: GENERIC_INTERNAL_ERROR: No enum constant org.apache.parquet.schema.OriginalType.2a

It doesn't give any specific information like what field is causing this issue. The same insert statement seem to work for all other tables except for just one. Please advise and let me know if any more clarifications is required.

Topics
StorageAnalyticsDatabase
Tags
Amazon Simple Storage ServiceAmazon AthenaAnalyticsAWS GlueExtract Transform & Load Data
Language
English
rePost-User-1711184
asked 2 years ago291 views
1 Answer
0

The generic error you are receiving (GENERIC_INTERNAL_ERROR: No enum constant org.apache.parquet.schema.OriginalType.2a) is not accurately traceable without context of the data in the file you are processing and the specific transforms that are being applied.

Please check that the entire dataset you are transforming to parquet is actually convertible to the destination column type. You could manually check the source file or you could try using the type casting functionality in Athena to convert columns to a specific type to see that it is valid.

DarronD
answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content