TABLE_REDIRECTION_ERROR on Glue Catalog Delta Table

0

I have a Databricks pipeline set up to create Delta tables, using Glue Catalog as the Metastore. I was able to query the Delta table via Athena successfully. However, starting from 2024-02-06, I began encountering TABLE_REDIRECTION_ERROR.

SELECT * FROM "<database>"."<table>" limit 10;
TABLE_REDIRECTION_ERROR: Table 'awsdatacatalog.<database>.<table>' redirected to 'awsdatacatalog$delta-lake-aws.<database>.<table>', 
but the target table 'awsdatacatalog$delta-lake-aws.<database>.<table>' does not exist.!

Enter image description here

SEAC
gefragt vor 3 Monaten159 Aufrufe
1 Antwort
0

Hello,

I would like to inform in Athena, for Delta Lake tables, CREATE TABLE statements should include only the LOCATION and table_type property. Hence, any additional table properties are not supported in Athena for delta table. I would suggest you to check the table DDL and verify if it contains any other property like CLUSTER BY then remove it from create table statement.

--Reference:

[1] https://docs.aws.amazon.com/athena/latest/ug/delta-lake-tables.html#delta-lake-tables-getting-started [2] https://docs.aws.amazon.com/athena/latest/ug/delta-lake-tables.html#delta-lake-tables-considerations-and-limitations

AWS
beantwortet vor 2 Monaten

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen