TABLE_REDIRECTION_ERROR on Glue Catalog Delta Table

0

I have a Databricks pipeline set up to create Delta tables, using Glue Catalog as the Metastore. I was able to query the Delta table via Athena successfully. However, starting from 2024-02-06, I began encountering TABLE_REDIRECTION_ERROR.

SELECT * FROM "<database>"."<table>" limit 10;
TABLE_REDIRECTION_ERROR: Table 'awsdatacatalog.<database>.<table>' redirected to 'awsdatacatalog$delta-lake-aws.<database>.<table>', 
but the target table 'awsdatacatalog$delta-lake-aws.<database>.<table>' does not exist.!

Enter image description here

SEAC
preguntada hace 3 meses158 visualizaciones
1 Respuesta
0

Hello,

I would like to inform in Athena, for Delta Lake tables, CREATE TABLE statements should include only the LOCATION and table_type property. Hence, any additional table properties are not supported in Athena for delta table. I would suggest you to check the table DDL and verify if it contains any other property like CLUSTER BY then remove it from create table statement.

--Reference:

[1] https://docs.aws.amazon.com/athena/latest/ug/delta-lake-tables.html#delta-lake-tables-getting-started [2] https://docs.aws.amazon.com/athena/latest/ug/delta-lake-tables.html#delta-lake-tables-considerations-and-limitations

AWS
respondido hace 2 meses

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas