Does SQS reach "unlimited capacity" instantaneously, or do I need to spread messages (ramp up) over some time?

0

The Quotas related to messages documentation page for SQS says:

Standard queues support a nearly unlimited number of API calls per second, per API action (SendMessage, ReceiveMessage, or DeleteMessage).

Can I suddenly send a lot of messages (from many separate clients at the same time) to a queue that was previously not getting any traffic? Or do I need to ramp up the number of messages per second in some kind of progressive way?

For example:

  • Can I send no message to a queue for 23 hours and 59 minutess and then send (thousands? dozens of thousands? hundreds of thousands?) messages per second during one minute?
  • Or do I need to spread those messages over a longer time, maybe ramping up over half an hour before I can reach max throughput?
질문됨 2년 전1758회 조회
3개 답변
1

A single Amazon SQS message queue can contain an unlimited number of messages. However, there is a 120,000 quota for the number of inflight messages for a standard queue and 20,000 for a FIFO queue. There is also a throughput quota with SQS - By default, FIFO queues support up to 3,000 messages per second with batching or up to 300 messages per second (300 send, receive, or delete operations per second) without batching. If you require higher throughput, you can enable high throughput mode for FIFO on the Amazon SQS console, which will support up to 30,000 messages per second with batching, or up to 3,000 messages per second without batching. Refer to https://aws.amazon.com/sqs/faqs/ and is a useful resource for additional information about SQS.

Tim_A
답변함 2년 전
profile pictureAWS
전문가
검토됨 2년 전
0

Yes it is possible. I have not seen any issues with receiving messages all of the sudden.

답변함 2년 전
0

There will be a limit to how many messages your producers can reliably send and I would recommend testing this. However, SQS distributes your queue over a number of SQS instances to support scale and resilience.

From AWS Blog

In order to make SQS scalable, durable, and reliable, messages are stored in a fleet that consists of thousands of servers in each AWS Region. Within a region, we save three copies of each message, taking care to distribute the messages across storage nodes and Availability Zones. In addition to this built-in redundant storage, SQS is self-healing and resilient to host failures & network interruptions.

From SQS FAQ

You can scale the amount of traffic you send to Amazon SQS up or down without any configuration

From Basic Amazon SQS architecture

redundantly stores the messages across multiple Amazon SQS servers

AWS
Matt_S
답변함 2년 전
profile pictureAWS
전문가
검토됨 2년 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠