How to check/determine image/container size for aws managed images ?
I'm using one of the images listed here https://github.com/aws/deep-learning-containers/blob/master/available_images.md, to create an model such that I can tie that up with a sagemaker serverless endpoint , but I keep getting "failed reason: Image size 15136109518 is greater that suppported size 1073741824" . this work when the endpoint configuration is not serverless. is there any documentation around image/container size for aws managed images?
It sounds like you set up a serverless endpoint with 1GB of memory and the image is larger than that. You can increase the memory size of your endpoint with the MemorySizeInMB parameter, more info in this documentation: https://docs.aws.amazon.com/sagemaker/latest/dg/serverless-endpoints-create.html#serverless-endpoints-create-config
If you pick a larger value for that (e.g. 4096 MB) then it should hopefully work.
@Heiko - also , when i create the endpoint configuration as Provisioned instead of serverless , it doesn't complain about the image size.
I just realised (it was hard to see without the thousand separators) that the image you're pulling is close to 16GB (I initially thought it was 1.6GB). Because it is 16 GB, even a config with 6GB memory won't be enough. It also makes sense that a provisioned instance doesn't complain as a provisioned instance has much more memory than a serverless endpoint.
Can I ask the reason why you try to pick the image manually? Just asking because the Sagemaker API can pick the right image for you: https://sagemaker.readthedocs.io/en/stable/api/utility/image_uris.html
Example:
region = boto3.session.Session().region_name image_uri = sagemaker.image_uris.retrieve( framework='huggingface', base_framework_version='pytorch1.7', region=region, version='4.6', py_version='py36', instance_type='ml.m5.large', image_scope='inference' )And here is an example notebook that might be helpful: https://github.com/marshmellow77/nlp-serverless/blob/main/1_model_train_deploy.ipynb
Relevant questions
Amazon Rekognition error
asked a month agoHow to check/determine image/container size for aws managed images ?
asked 3 months agoMultiple images in a HIT with python API
asked 3 years agoChanging Workspace AD from SimpleAD to AWS Managed AD
Accepted Answerasked 2 years agoFaceId's when indexing multiple face images of same person
asked a month agoCosts for Batch Rekognition OCR
Accepted Answerasked 5 months agoCustom labels programmatically
Accepted Answerasked 2 years agoHow to display images from S3 bucket in AWS Pinpoint email templates?
asked 13 days agoDocker Image for Greengrass V2
Accepted Answerasked a year agoWhat is the maximum size for a lambda docker image ?
Accepted Answerasked a year ago
@Heiko - thanks, I tried with the max as well , i.e. 6 GB. I still get same error message.