AWS Glue job can't convert number to double

0

Hi all, I have problem converting json number values to double in aws glue, if I specify 'double' in column mappings in aws glue job and input is json number format that is being read from s3 bucket. Job is writting all nulls in redshift, can someone help on this matter?

Thank you

demandé il y a 2 ans1151 vues
1 réponse
0

Hello,

I understand when you convert number to double in applymapping it is writing null values to Redshift. To confirm the above behaviour I have tested with a sample json file and converted one number column to double in applymapping and it has successfully converted to double.

I would suggest before and after applymapping transformation, Please check your schema and data to confirm if you are getting correct data and schema or not. Also if you are writing to an existing Redshift table verify the schema at Redshift end as well.

++++++++

datasource0.printSchema()

datasource0.toDF().show(5)

applymapping1.printSchema()

applymapping1.toDF().show(5)

+++++++

To find out the exact issue, we require your sample data and script. Hence Please feel free to reach out to AWS Premium Support with sample data and script and we will be happy to help.

AWS
répondu il y a 2 ans

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions