TABLE_REDIRECTION_ERROR on Glue Catalog Delta Table

0

I have a Databricks pipeline set up to create Delta tables, using Glue Catalog as the Metastore. I was able to query the Delta table via Athena successfully. However, starting from 2024-02-06, I began encountering TABLE_REDIRECTION_ERROR.

SELECT * FROM "<database>"."<table>" limit 10;
TABLE_REDIRECTION_ERROR: Table 'awsdatacatalog.<database>.<table>' redirected to 'awsdatacatalog$delta-lake-aws.<database>.<table>', 
but the target table 'awsdatacatalog$delta-lake-aws.<database>.<table>' does not exist.!

Enter image description here

SEAC
질문됨 3달 전158회 조회
1개 답변
0

Hello,

I would like to inform in Athena, for Delta Lake tables, CREATE TABLE statements should include only the LOCATION and table_type property. Hence, any additional table properties are not supported in Athena for delta table. I would suggest you to check the table DDL and verify if it contains any other property like CLUSTER BY then remove it from create table statement.

--Reference:

[1] https://docs.aws.amazon.com/athena/latest/ug/delta-lake-tables.html#delta-lake-tables-getting-started [2] https://docs.aws.amazon.com/athena/latest/ug/delta-lake-tables.html#delta-lake-tables-considerations-and-limitations

AWS
답변함 2달 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠