How do I get the output of an AWS Glue DataBrew job to be a single CSV file?
0
I'm running a test AWS Glue DataBrew job to run a simple Group By and Sum operation on a CSV dataset that contains total costs by product each day. The desired output is a single CSV file with three columns: Day (timestamp), total cost, and product ID.
After I make the changes in the DataBrew project and select Run Job, the job runs successfully, but the output is numerous CSV files. Is there a way for me to specify that I want the output to just be one file, rather than multiple files?
1 réponse
- Le plus récent
- Le plus de votes
- La plupart des commentaires
0
You have two options:
- Download the processed recipe directly from the project workspace. (Note: This option is limited to the sample data on screen and has a maximum row size of 5000.)
- Write an AWS Glue extract, transform, and load (ETL) job to repartition the data before writing a DynamicFrame to Amazon S3.
répondu il y a 3 ans
Contenus pertinents
- demandé il y a un an
- demandé il y a 7 mois
- demandé il y a 2 mois
AWS OFFICIELA mis à jour il y a 3 ans- AWS OFFICIELA mis à jour il y a 3 ans
