How do I get the output of an AWS Glue DataBrew job to be a single CSV file?
0
I'm running a test AWS Glue DataBrew job to run a simple Group By and Sum operation on a CSV dataset that contains total costs by product each day. The desired output is a single CSV file with three columns: Day (timestamp), total cost, and product ID.
After I make the changes in the DataBrew project and select Run Job, the job runs successfully, but the output is numerous CSV files. Is there a way for me to specify that I want the output to just be one file, rather than multiple files?
1回答
- 新しい順
- 投票が多い順
- コメントが多い順
0
You have two options:
- Download the processed recipe directly from the project workspace. (Note: This option is limited to the sample data on screen and has a maximum row size of 5000.)
- Write an AWS Glue extract, transform, and load (ETL) job to repartition the data before writing a DynamicFrame to Amazon S3.
回答済み 3年前
関連するコンテンツ
AWS公式更新しました 3年前- AWS公式更新しました 2年前
