The ideal value for MaxConcurrentTransforms varies based on instance type as well as based on your specific model.
it could make sense to increase MaxConcurrentTransforms up to the core count of the instance you are using (for cpu based transform), however, you should also take into account the memory utilisation by your model.
The ultimate answer is it "depends" and I would recommend that you experiment with increasing this number gradually from 1 up to instance core count, while monitoring RAM/cpu utilisation to find the optimal.
Load balancing is not happening on sagemaker batch transform jobasked 7 months ago
how to configure max concurrent transforms and instance count parameter in batch transform ?
How to automate sagemaker batch transform?Accepted Answer
xgboost sagemaker batch transform job output in multiple linesAccepted Answerasked 2 years ago
how to configure ideal value for MaxConcurrentTransforms in setting up a sagemaker batch transform ?Accepted Answer
Is there a way to automate failure handling and retries when using Amazon SageMaker batch transform?Accepted AnswerEXPERTasked 2 years ago
SageMaker Batch Transform local mode?Accepted AnswerEXPERTasked 3 years ago
how to log error/messages in while running a sagemaker batch transform job?asked 4 months ago
How to pass null/Nan values into the dataframe passed into batch transformasked 4 years ago
How to avoid multiple “Completed” events from SageMaker batch transform jobasked 2 years ago