Redshift Serverless Storage Limitations

0

With Provisioned Clusters, the maximum limit of the storage on RA3 (considering the maximum number of nodes) is around 16PB

What is the maximum limit on the amount of data that can be stored with AWS Redshift Serverless?

asked a year ago1816 views
2 Answers
2

With Redshift Serverless you do not provision nodes. Instead you start with Base RPU, which is Redshift Processing Units. You can go as high as 512 RPU's. Redshift Serverless handles the provisioning and scaling of compute for you. The serverless instance can scale higher from the Base RPU to accommodate more queries as they come in automatically up to the usage limit you specify in Max RPU's.

Recently announced configurations of 8 RPU and 16 RPU support Redshift managed storage (RMS) capacity of up to 128 TB. If you're using more than 128 TB of managed storage, you can't downgrade to less than 32 RPU.

Max storage for Redshift Serverless is 8 PB of RMS for 512 RPUs.

profile pictureAWS
answered a year ago
  • Max storage for Redshift Serverless is 8 PB of RMS for 512 RPUs, Is there a documentation somewhere on this?

  • I was searching for documentation link and indeed this is not currently documented. I have passed a note to the Redshift PM's for adding this to documentation.

2

The maximum limit on the amount of data that can be stored with AWS Redshift Serverless depends on the size of the cluster, which can scale dynamically based on workload demands.

AWS Redshift Serverless allows you to store petabytes of data in a cost-effective manner without having to manage complex infrastructure or manually scaling your cluster. The amount of data you can store depends on the size of the cluster you provision, which can be scaled up or down based on your workload requirements.

With AWS Redshift Serverless, you can scale your cluster from 1 to 128 compute nodes, and each node can have up to 60TB of storage. This means that the maximum amount of data you can store with AWS Redshift Serverless is up to 7.68 petabytes (assuming 128 nodes, each with 60TB of storage).

It's worth noting that the actual amount of data you can store may be less than the maximum limit due to other factors, such as compression, replication, and other metadata that is stored in your cluster.

AWS_Guy
answered a year ago
  • With AWS Redshift Serverless, we do not provision the nodes instead we select the RPUs.

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions