SageMaker Batch Transform will automatically split your input file into whatever payload size is specified if you use
"SplitType": "Line" and
"BatchStrategy": "MultiRecord". There's no need to split files yourself or to use large payload sizes unless you have very large single records.
Hope that helps!
- asked a year ago
- How do I mount an existing Amazon FSx for Lustre file system to AWS Batch in a managed compute environment?AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated 2 months ago
- AWS OFFICIALUpdated 2 years ago