Merge into query using Iceberg table throws iceberg v2 support error

0

I am trying to merge two iceberg tables using Athena but ran into error: "NOT_SUPPORTED: Iceberg table updates require at least format version 2". However, according to this aws documentation, Athena only supports iceberg v2 tables.

Here is the Athena query I am executing:

MERGE INTO new_db_test.dynamo_export AS target USING new_db_test.staging_table AS source
    ON (target.id = source.Keys_id)
    WHEN MATCHED AND source.event_name = 'REMOVE' 
        THEN DELETE
    WHEN MATCHED AND source.event_name = 'MODIFY' 
        THEN UPDATE SET name = source.name, is_active = source.is_active, description = source.description, id = source.id
    WHEN NOT MATCHED AND source.event_name = 'INSERT' 
        THEN INSERT (description, id, is_active, name, number, price) 
            VALUES (source.description, source.id, source.is_active, source.name, NULL, NULL)
azmaktr
feita há 2 meses327 visualizações
1 Resposta
0
Resposta aceita

I found the solution, the target table generated with spark is using table format version 1.0

azmaktr
respondido há 2 meses

Você não está conectado. Fazer login para postar uma resposta.

Uma boa resposta responde claramente à pergunta, dá feedback construtivo e incentiva o crescimento profissional de quem perguntou.

Diretrizes para responder a perguntas