GENERIC_INTERNAL_ERROR: Dictionary is missing for Page

Question

Queries fail on iceberg table, possibly after running OPTIMIZE
It's unclear if it is specifically because of null values. 
GENERIC_INTERNAL_ERROR: Dictionary is missing for Page

Spark/Glue also fails on some queries that touch the relevant data. 
In general, athena will respond to queries on some data, but not the specific affected files.

Answer

Hello,

Please refer the below resolution guide that details that this error is typically due to a data type mismatch between the table definition and the source data:
https://aws.amazon.com/premiumsupport/knowledge-center/athena-generic-internal-error

As confirmed by you, some queries execute successfully and some queries fail. To address this issue, please verify that the source data files are valid and have the same schema as the table definition.

GENERIC_INTERNAL_ERROR: Dictionary is missing for Page

Relevant content