Merge into query using Iceberg table throws iceberg v2 support error

0

I am trying to merge two iceberg tables using Athena but ran into error: "NOT_SUPPORTED: Iceberg table updates require at least format version 2". However, according to this aws documentation, Athena only supports iceberg v2 tables.

Here is the Athena query I am executing:

MERGE INTO new_db_test.dynamo_export AS target USING new_db_test.staging_table AS source
    ON (target.id = source.Keys_id)
    WHEN MATCHED AND source.event_name = 'REMOVE' 
        THEN DELETE
    WHEN MATCHED AND source.event_name = 'MODIFY' 
        THEN UPDATE SET name = source.name, is_active = source.is_active, description = source.description, id = source.id
    WHEN NOT MATCHED AND source.event_name = 'INSERT' 
        THEN INSERT (description, id, is_active, name, number, price) 
            VALUES (source.description, source.id, source.is_active, source.name, NULL, NULL)
azmaktr
posta 3 mesi fa420 visualizzazioni
1 Risposta
0
Risposta accettata

I found the solution, the target table generated with spark is using table format version 1.0

azmaktr
con risposta 3 mesi fa

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande