HIVE_BAD_DATA with Parquet BINARY

0

Hi,

I saved some Parquet files (with Spark), and some of the fields were converted to Timestamp types. That appears to be saved as INT96, or BINARY, inside Parquet.

When I declare the columns as TIMESTAMP in Amazon Athena, and then try to invoke them, I receive this error message:

HIVE_BAD_DATA: Field scheduled_content_start_time's type BINARY in parquet is incompatible with type bigint defined in table schema

However, if I try to declare the column as type BINARY, it tells be that BINARY is not supported for Parquet file format.

How can I resolve this?

Thanks,
Michael

msjg
feita há 7 anos1875 visualizações
2 Respostas
0

you could use string

respondido há 7 anos
0

Hi,

Good day.

But can you query a string as you would a timestamp tough?

Regards
JJ

respondido há 6 anos

Você não está conectado. Fazer login para postar uma resposta.

Uma boa resposta responde claramente à pergunta, dá feedback construtivo e incentiva o crescimento profissional de quem perguntou.

Diretrizes para responder a perguntas