AWS Glue job can't convert number to double

0

Hi all, I have problem converting json number values to double in aws glue, if I specify 'double' in column mappings in aws glue job and input is json number format that is being read from s3 bucket. Job is writting all nulls in redshift, can someone help on this matter?

Thank you

質問済み 2年前1151ビュー
1回答
0

Hello,

I understand when you convert number to double in applymapping it is writing null values to Redshift. To confirm the above behaviour I have tested with a sample json file and converted one number column to double in applymapping and it has successfully converted to double.

I would suggest before and after applymapping transformation, Please check your schema and data to confirm if you are getting correct data and schema or not. Also if you are writing to an existing Redshift table verify the schema at Redshift end as well.

++++++++

datasource0.printSchema()

datasource0.toDF().show(5)

applymapping1.printSchema()

applymapping1.toDF().show(5)

+++++++

To find out the exact issue, we require your sample data and script. Hence Please feel free to reach out to AWS Premium Support with sample data and script and we will be happy to help.

AWS
回答済み 2年前

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン