Sagemaker batch transform
0
Hi, it seems that Sagemaker Batch Transform is limited to 100MB payloads I'd like to run preds against a 5GB csv file, what the recommended way to do so?
- Etiquetas
- Amazon SageMaker
- Idioma
- English
1 Respuesta
- Más nuevo
- Más votos
- Más comentarios
1
SageMaker Batch Transform will automatically split your input file into whatever payload size is specified if you use "SplitType": "Line" and "BatchStrategy": "MultiRecord". There's no need to split files yourself or to use large payload sizes unless you have very large single records.
Hope that helps!
Contenido relevante
preguntada hace un año
preguntada hace 9 meses
preguntada hace 7 meses
preguntada hace 10 meses
- OFICIAL DE AWSActualizada hace 2 años
@Olivier_CR - i'm curious , how are you creating this batch jobs, are you doing it via console, cli or using lambda to do it via code?