AWS GLUE JOB NOT DETECTING SCHEMA IN PYTHON SCRIPT

1

Hi, I have created a new AWS Glue visual ETL job with source- PostgreSQL, target- Snowflake. Output schema option shows correct schema as per the source, but the python script shows all the datatype as VARCHAR and the target snowflake table all columns are created with datatype - VARCHAR. Please let me know if there is any option to auto detect the schema in python script. Enter image description here Enter image description here

demandé il y a 6 mois146 vues
2 réponses
0

Seems that's a limitation of that target node, I've opened a ticket to request that it honors the schema.

profile pictureAWS
EXPERT
répondu il y a 6 mois
  • Is there a way to transfert data using a script without losing the data type ? Do you have the link of the ticket you speak about?

0

Workaround found : "Just" change the python script manually to fix the output data type

Thomas
répondu il y a 3 mois

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions