getting error in querying data in athena table

0

Hello, i am getting below error while querying data in athena table.

select * from fdp_test_iceberg.tabular_ident_transformed_iceberg_table;

error- ICEBERG_BAD_DATA: Multiple entries with same key: 20=data.account.acid and 20=acid This query ran against the "fdp_test_iceberg" database, unless qualified by the query. Please post the error message on our forum or contact customer support with Query Id:

asked a month ago54 views
1 Answer
0

The error you're encountering, "ICEBERG_BAD_DATA: Multiple entries with same key: 20=data.account.acid and 20=acid", suggests an issue with duplicate keys in your Iceberg table data. This problem typically occurs when there are inconsistencies in the table's metadata or data files.

To resolve this issue, you can try the following steps:

  1. Verify the table's schema and ensure that there are no duplicate column names or conflicting data types.

  2. Check if there have been any recent changes or updates to the table that might have introduced inconsistencies.

  3. Consider running a table repair or optimization operation if available for Iceberg tables in Athena.

  4. If the issue persists, you may need to recreate the table with clean data, ensuring that there are no duplicate keys in the process.

  5. If you're using partitioned tables, verify that the partitioning is correct and there are no overlapping or duplicate partition keys.

If these steps don't resolve the issue, it may be necessary to investigate the underlying data files and metadata more closely. In some cases, you might need to reach out to AWS Support for further assistance, providing them with the specific query ID and details about your table structure and recent operations performed on it.
Sources
Troubleshoot Athena Apache Iceberg table errors | AWS re:Post
Athena : TYPE_NOT_FOUND: Unknown type: row | AWS re:Post

profile picture
answered a month ago
AWS
SUPPORT ENGINEER
reviewed a month ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions