HIVE_BAD_DATA with Parquet BINARY

0

Hi,

I saved some Parquet files (with Spark), and some of the fields were converted to Timestamp types. That appears to be saved as INT96, or BINARY, inside Parquet.

When I declare the columns as TIMESTAMP in Amazon Athena, and then try to invoke them, I receive this error message:

HIVE_BAD_DATA: Field scheduled_content_start_time's type BINARY in parquet is incompatible with type bigint defined in table schema

However, if I try to declare the column as type BINARY, it tells be that BINARY is not supported for Parquet file format.

How can I resolve this?

Thanks,
Michael

msjg
asked 7 years ago1838 views
2 Answers
0

you could use string

answered 7 years ago
0

Hi,

Good day.

But can you query a string as you would a timestamp tough?

Regards
JJ

answered 6 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions