HIVE_BAD_DATA with Parquet BINARY

0

Hi,

I saved some Parquet files (with Spark), and some of the fields were converted to Timestamp types. That appears to be saved as INT96, or BINARY, inside Parquet.

When I declare the columns as TIMESTAMP in Amazon Athena, and then try to invoke them, I receive this error message:

HIVE_BAD_DATA: Field scheduled_content_start_time's type BINARY in parquet is incompatible with type bigint defined in table schema

However, if I try to declare the column as type BINARY, it tells be that BINARY is not supported for Parquet file format.

How can I resolve this?

Thanks,
Michael

msjg
preguntada hace 7 años1875 visualizaciones
2 Respuestas
0

you could use string

respondido hace 7 años
0

Hi,

Good day.

But can you query a string as you would a timestamp tough?

Regards
JJ

respondido hace 6 años

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas