Merge into query using Iceberg table throws iceberg v2 support error

0

I am trying to merge two iceberg tables using Athena but ran into error: "NOT_SUPPORTED: Iceberg table updates require at least format version 2". However, according to this aws documentation, Athena only supports iceberg v2 tables.

Here is the Athena query I am executing:

MERGE INTO new_db_test.dynamo_export AS target USING new_db_test.staging_table AS source
    ON (target.id = source.Keys_id)
    WHEN MATCHED AND source.event_name = 'REMOVE' 
        THEN DELETE
    WHEN MATCHED AND source.event_name = 'MODIFY' 
        THEN UPDATE SET name = source.name, is_active = source.is_active, description = source.description, id = source.id
    WHEN NOT MATCHED AND source.event_name = 'INSERT' 
        THEN INSERT (description, id, is_active, name, number, price) 
            VALUES (source.description, source.id, source.is_active, source.name, NULL, NULL)
azmaktr
demandé il y a 3 mois418 vues
1 réponse
0
Réponse acceptée

I found the solution, the target table generated with spark is using table format version 1.0

azmaktr
répondu il y a 3 mois

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions