AWS Glue job can't convert number to double

0

Hi all, I have problem converting json number values to double in aws glue, if I specify 'double' in column mappings in aws glue job and input is json number format that is being read from s3 bucket. Job is writting all nulls in redshift, can someone help on this matter?

Thank you

已提问 2 年前1151 查看次数
1 回答
0

Hello,

I understand when you convert number to double in applymapping it is writing null values to Redshift. To confirm the above behaviour I have tested with a sample json file and converted one number column to double in applymapping and it has successfully converted to double.

I would suggest before and after applymapping transformation, Please check your schema and data to confirm if you are getting correct data and schema or not. Also if you are writing to an existing Redshift table verify the schema at Redshift end as well.

++++++++

datasource0.printSchema()

datasource0.toDF().show(5)

applymapping1.printSchema()

applymapping1.toDF().show(5)

+++++++

To find out the exact issue, we require your sample data and script. Hence Please feel free to reach out to AWS Premium Support with sample data and script and we will be happy to help.

AWS
已回答 2 年前

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则