Upsert into MySQL target using AWS Glue

0

Is there a provision to upsert into MySQL database?

Below post on related topic mentioned an "Upsert box" in Glue Studio, which I am not able to find - https://repost.aws/questions/QUNfyJnyqIRbabAa_Drw_ugw/aws-glue-upsert-operation-for-few-columns

Thanks

demandé il y a 2 ans1304 vues
1 réponse
0
Réponse acceptée

Hi There

Upsert is available for Redshift targets not MySQL

You will need to have custom logic to do other operations besides Inserts. Check out this article for one way of doing updates on MySQL using pymysql. https://awstip.com/aws-etl-glue-job-insert-update-support-7a396db832b

profile pictureAWS
EXPERT
Matt-B
répondu il y a 2 ans
profile picture
EXPERT
vérifié il y a 10 mois
AWS
EXPERT
vérifié il y a 2 ans
  • I tried the solution proposed in the article. However, it looks like the job is timing out on below line - connection = glue_client.get_connection(Name="<My Connection>")

    I do not see any exception in the logs.

    The same connection worked when I used it in another job for insert-only, created from Visual editor. Also, test connection works fine.

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions