TABLE_REDIRECTION_ERROR on Glue Catalog Delta Table

0

I have a Databricks pipeline set up to create Delta tables, using Glue Catalog as the Metastore. I was able to query the Delta table via Athena successfully. However, starting from 2024-02-06, I began encountering TABLE_REDIRECTION_ERROR.

SELECT * FROM "<database>"."<table>" limit 10;
TABLE_REDIRECTION_ERROR: Table 'awsdatacatalog.<database>.<table>' redirected to 'awsdatacatalog$delta-lake-aws.<database>.<table>', 
but the target table 'awsdatacatalog$delta-lake-aws.<database>.<table>' does not exist.!

Enter image description here

SEAC
asked 3 months ago148 views
1 Answer
0

Hello,

I would like to inform in Athena, for Delta Lake tables, CREATE TABLE statements should include only the LOCATION and table_type property. Hence, any additional table properties are not supported in Athena for delta table. I would suggest you to check the table DDL and verify if it contains any other property like CLUSTER BY then remove it from create table statement.

--Reference:

[1] https://docs.aws.amazon.com/athena/latest/ug/delta-lake-tables.html#delta-lake-tables-getting-started [2] https://docs.aws.amazon.com/athena/latest/ug/delta-lake-tables.html#delta-lake-tables-considerations-and-limitations

AWS
answered 2 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions