AWS GLUE JOB NOT DETECTING SCHEMA IN PYTHON SCRIPT

1

Hi, I have created a new AWS Glue visual ETL job with source- PostgreSQL, target- Snowflake. Output schema option shows correct schema as per the source, but the python script shows all the datatype as VARCHAR and the target snowflake table all columns are created with datatype - VARCHAR. Please let me know if there is any option to auto detect the schema in python script. Enter image description here Enter image description here

preguntada hace 6 meses146 visualizaciones
2 Respuestas
0

Seems that's a limitation of that target node, I've opened a ticket to request that it honors the schema.

profile pictureAWS
EXPERTO
respondido hace 6 meses
  • Is there a way to transfert data using a script without losing the data type ? Do you have the link of the ticket you speak about?

0

Workaround found : "Just" change the python script manually to fix the output data type

Thomas
respondido hace 3 meses

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas