AWS Glue job can't convert number to double

0

Hi all, I have problem converting json number values to double in aws glue, if I specify 'double' in column mappings in aws glue job and input is json number format that is being read from s3 bucket. Job is writting all nulls in redshift, can someone help on this matter?

Thank you

질문됨 2년 전1151회 조회
1개 답변
0

Hello,

I understand when you convert number to double in applymapping it is writing null values to Redshift. To confirm the above behaviour I have tested with a sample json file and converted one number column to double in applymapping and it has successfully converted to double.

I would suggest before and after applymapping transformation, Please check your schema and data to confirm if you are getting correct data and schema or not. Also if you are writing to an existing Redshift table verify the schema at Redshift end as well.

++++++++

datasource0.printSchema()

datasource0.toDF().show(5)

applymapping1.printSchema()

applymapping1.toDF().show(5)

+++++++

To find out the exact issue, we require your sample data and script. Hence Please feel free to reach out to AWS Premium Support with sample data and script and we will be happy to help.

AWS
답변함 2년 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠