Amazon SageMaker upload limit

Question

Just a quick question. Looking to upload about 200GB of CSV files for machine learning training onto the Amazon SageMaker studio notebook. Was wondering if it is possible? What is the limit? And, if it cost extra... how much would that be?

Riku_Kobayashi · Answer

SageMaker Studio uses EFS for storage.  
EFS scales to the petabyte level, so a 200 GB file can be stored.  
https://docs.aws.amazon.com/sagemaker/latest/dg/studio-tasks-manage-storage.html

https://aws.amazon.com/efs/features/?nc1=h_ls  
> With Amazon EFS, storage capacity is elastic, growing and shrinking automatically as you add and remove files to dynamically provide storage capacity to your applications as needed. With elastic capacity, provisioning is unnecessary, and you’re billed only for what you use. Amazon EFS is designed to be highly scalable both in storage capacity and throughput performance, growing to petabyte scale with massively parallel access from EC2 instances.

So to calculate the 200 GB rate, we use the EFS rate.  
As for the fees, they would be as follows.  
EFS is free up to 5GB per month, so we are doing minus 5GB.  
Calculated in US East.  
https://aws.amazon.com/efs/features/?nc1=h_ls  
```
(200GB - 5GB) * 0.30USD = 58.5USD
```

Amazon SageMaker upload limit

Add your answer

Relevant content