Merge into query using Iceberg table throws iceberg v2 support error

0

I am trying to merge two iceberg tables using Athena but ran into error: "NOT_SUPPORTED: Iceberg table updates require at least format version 2". However, according to this aws documentation, Athena only supports iceberg v2 tables.

Here is the Athena query I am executing:

MERGE INTO new_db_test.dynamo_export AS target USING new_db_test.staging_table AS source
    ON (target.id = source.Keys_id)
    WHEN MATCHED AND source.event_name = 'REMOVE' 
        THEN DELETE
    WHEN MATCHED AND source.event_name = 'MODIFY' 
        THEN UPDATE SET name = source.name, is_active = source.is_active, description = source.description, id = source.id
    WHEN NOT MATCHED AND source.event_name = 'INSERT' 
        THEN INSERT (description, id, is_active, name, number, price) 
            VALUES (source.description, source.id, source.is_active, source.name, NULL, NULL)
azmaktr
質問済み 2ヶ月前308ビュー
1回答
0
承認された回答

I found the solution, the target table generated with spark is using table format version 1.0

azmaktr
回答済み 2ヶ月前

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン

関連するコンテンツ