1개 답변
- 최신
- 최다 투표
- 가장 많은 댓글
0
From the looks of it your DynamicFrames are partitioning your files, You can repartition them.
Try the following: https://repost.aws/knowledge-center/glue-job-output-large-files
답변함 일 년 전
관련 콘텐츠
- AWS 공식업데이트됨 2년 전
From the looks of it your DynamicFrames are partitioning your files, You can repartition them.
Try the following: https://repost.aws/knowledge-center/glue-job-output-large-files
Inside that "Custom transform", you can just call "repartition(1)" before you return the DF