Does SQS reach "unlimited capacity" instantaneously, or do I need to spread messages (ramp up) over some time?

0

The Quotas related to messages documentation page for SQS says:

Standard queues support a nearly unlimited number of API calls per second, per API action (SendMessage, ReceiveMessage, or DeleteMessage).

Can I suddenly send a lot of messages (from many separate clients at the same time) to a queue that was previously not getting any traffic? Or do I need to ramp up the number of messages per second in some kind of progressive way?

For example:

  • Can I send no message to a queue for 23 hours and 59 minutess and then send (thousands? dozens of thousands? hundreds of thousands?) messages per second during one minute?
  • Or do I need to spread those messages over a longer time, maybe ramping up over half an hour before I can reach max throughput?
asked a year ago171 views
3 Answers
1

A single Amazon SQS message queue can contain an unlimited number of messages. However, there is a 120,000 quota for the number of inflight messages for a standard queue and 20,000 for a FIFO queue. There is also a throughput quota with SQS - By default, FIFO queues support up to 3,000 messages per second with batching or up to 300 messages per second (300 send, receive, or delete operations per second) without batching. If you require higher throughput, you can enable high throughput mode for FIFO on the Amazon SQS console, which will support up to 30,000 messages per second with batching, or up to 3,000 messages per second without batching. Refer to https://aws.amazon.com/sqs/faqs/ and is a useful resource for additional information about SQS.

Tim_A
answered a year ago
profile picture
EXPERT
reviewed a year ago
0

Yes it is possible. I have not seen any issues with receiving messages all of the sudden.

answered a year ago
0

There will be a limit to how many messages your producers can reliably send and I would recommend testing this. However, SQS distributes your queue over a number of SQS instances to support scale and resilience.

From AWS Blog

In order to make SQS scalable, durable, and reliable, messages are stored in a fleet that consists of thousands of servers in each AWS Region. Within a region, we save three copies of each message, taking care to distribute the messages across storage nodes and Availability Zones. In addition to this built-in redundant storage, SQS is self-healing and resilient to host failures & network interruptions.

From SQS FAQ

You can scale the amount of traffic you send to Amazon SQS up or down without any configuration

From Basic Amazon SQS architecture

redundantly stores the messages across multiple Amazon SQS servers

Matt_S
answered a year ago
profile picture
EXPERT
reviewed a year ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions