AWS GLUE JOB NOT DETECTING SCHEMA IN PYTHON SCRIPT

1

Hi, I have created a new AWS Glue visual ETL job with source- PostgreSQL, target- Snowflake. Output schema option shows correct schema as per the source, but the python script shows all the datatype as VARCHAR and the target snowflake table all columns are created with datatype - VARCHAR. Please let me know if there is any option to auto detect the schema in python script. Enter image description here Enter image description here

posta 6 mesi fa146 visualizzazioni
2 Risposte
0

Seems that's a limitation of that target node, I've opened a ticket to request that it honors the schema.

profile pictureAWS
ESPERTO
con risposta 6 mesi fa
  • Is there a way to transfert data using a script without losing the data type ? Do you have the link of the ticket you speak about?

0

Workaround found : "Just" change the python script manually to fix the output data type

Thomas
con risposta 3 mesi fa

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande