HIVE_BAD_DATA with Parquet BINARY

0

Hi,

I saved some Parquet files (with Spark), and some of the fields were converted to Timestamp types. That appears to be saved as INT96, or BINARY, inside Parquet.

When I declare the columns as TIMESTAMP in Amazon Athena, and then try to invoke them, I receive this error message:

HIVE_BAD_DATA: Field scheduled_content_start_time's type BINARY in parquet is incompatible with type bigint defined in table schema

However, if I try to declare the column as type BINARY, it tells be that BINARY is not supported for Parquet file format.

How can I resolve this?

Thanks,
Michael

msjg
posta 7 anni fa1876 visualizzazioni
2 Risposte
0

you could use string

con risposta 7 anni fa
0

Hi,

Good day.

But can you query a string as you would a timestamp tough?

Regards
JJ

con risposta 6 anni fa

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande