Queue solution to slow down speed rate of messages

0

Hello forum, I have a solutions architect question that need to be solved with some queuing strategy.

An external party sends us bursts of HTTP POST messages in a very quick rate of 15,000 per second. Our backend is not able to process all those messages at that speed. We need to receive them at 10 per second.

What would be the best option to slow down the speed of those messages?

Thank you for any feedback.

2 回答
1

Hi, the expected answer is most likely an SQS queue, but if you can only process 10 per second those 15,000-message bursts better not happen more often than every 1,500 seconds! Also SQS messages are limited to 256KB each. And if processing order needs to be preserved or duplicates removed, it would need to be a FIFO SQS queue not a standard one with "at least once" delivery.

专家
已回答 1 年前
profile pictureAWS
专家
kentrad
已审核 1 年前
  • Thank you for your answer. No, those bursts don't happen more than once an hour and each message is only a few bytes.

0

The answer was actually easier than I originally thought. We just configured the receiving NGINX server to send 429 (Too many requests) after X messages/s.

已回答 1 年前

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则

相关内容