AWS GLUE JOB NOT DETECTING SCHEMA IN PYTHON SCRIPT

1

Hi, I have created a new AWS Glue visual ETL job with source- PostgreSQL, target- Snowflake. Output schema option shows correct schema as per the source, but the python script shows all the datatype as VARCHAR and the target snowflake table all columns are created with datatype - VARCHAR. Please let me know if there is any option to auto detect the schema in python script. Enter image description here Enter image description here

feita há 6 meses146 visualizações
2 Respostas
0

Seems that's a limitation of that target node, I've opened a ticket to request that it honors the schema.

profile pictureAWS
ESPECIALISTA
respondido há 6 meses
  • Is there a way to transfert data using a script without losing the data type ? Do you have the link of the ticket you speak about?

0

Workaround found : "Just" change the python script manually to fix the output data type

Thomas
respondido há 3 meses

Você não está conectado. Fazer login para postar uma resposta.

Uma boa resposta responde claramente à pergunta, dá feedback construtivo e incentiva o crescimento profissional de quem perguntou.

Diretrizes para responder a perguntas