AOSS max capacity

Question

Questions:

1) What is the *actual* size capacity on AOSS? Is it per INDEX or per COLLECTION (I've seen posts / docs saying different things). It seems to be 1TB per *something*
2) How can I get the size of the capacity? Is the metric "StorageUsedInS3?". Also again, do I need to sum it up for the entire collection? Or is that limit by index?

Notes:
I'm getting slightly conflicting answers from the docs re: AOSS (Amazon OpenSearch Serverless)
Specifically, I've found posts saying that the limit is 1TB per *collection*. The official docs say:

"Each OCU includes enough hot ephemeral storage for 120 GiB of index data. OpenSearch Serverless supports up to 1 TiB of data per index in search and vector search collections, and 30 TiB of hot data per index in a time series collection. For time series collections, you can still ingest more data, which can be stored as warm data in S3."

Srini V · Answer

The storage limit is 1TB per index, not per collection. Each individual index within a collection cannot exceed 1TB.

For monitoring storage usage:
    
* The primary metric is indeed "StorageUsedInS3"
*     You can monitor this metric per index using CloudWatch
*     The formula is: StorageUsedInS3 = Original data size + replica data size + overhead

To check your storage usage:
    
* Through CloudWatch metrics for your AOSS collection
*     Using the OpenSearch API's _cat/indices endpoint
*     Through the AWS Console in the OpenSearch Serverless section

For monitoring, I'd recommend setting up CloudWatch alarms at around 70-80% of the 1TB limit per index to give yourself enough time to take action before hitting the limit.

Please see similar question from the past
https://repost.aws/questions/QUee1ufV2-Ti6JFnqBSvlfNg/opensearch-serverless-scale-related-questions

and documentation for capacity limits
https://docs.aws.amazon.com/opensearch-service/latest/developerguide/serverless-scaling.html

AOSS max capacity

Add your answer

Relevant content