Upsert into MySQL target using AWS Glue

0

Is there a provision to upsert into MySQL database?

Below post on related topic mentioned an "Upsert box" in Glue Studio, which I am not able to find - https://repost.aws/questions/QUNfyJnyqIRbabAa_Drw_ugw/aws-glue-upsert-operation-for-few-columns

Thanks

posta 2 anni fa1304 visualizzazioni
1 Risposta
0
Risposta accettata

Hi There

Upsert is available for Redshift targets not MySQL

You will need to have custom logic to do other operations besides Inserts. Check out this article for one way of doing updates on MySQL using pymysql. https://awstip.com/aws-etl-glue-job-insert-update-support-7a396db832b

profile pictureAWS
ESPERTO
Matt-B
con risposta 2 anni fa
profile picture
ESPERTO
verificato 10 mesi fa
AWS
ESPERTO
verificato 2 anni fa
  • I tried the solution proposed in the article. However, it looks like the job is timing out on below line - connection = glue_client.get_connection(Name="<My Connection>")

    I do not see any exception in the logs.

    The same connection worked when I used it in another job for insert-only, created from Visual editor. Also, test connection works fine.

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande