Skip to content

Using Eventbridge targets with new SQS Fair Queue feature

0

AWS has a doc for fairness in standard SQS queues, called fair queues doc. Is it possible to use this feature if our messages are getting published via EventBridge targets? I searched through the EventBridge developer guide and didn't see anything new regarding the fair queues.

3 Answers
1

Currently, there is no direct support for using the SQS fair queues feature with EventBridge targets. The SQS fair queues feature requires setting a MessageGroupId on outgoing messages to identify different tenants, which helps mitigate the "noisy neighbor" problem in multi-tenant queues.

When sending messages directly to SQS, you can add this tenant identifier by setting the MessageGroupId parameter in your SendMessage request. However, when messages are sent to SQS via EventBridge targets, there is no documented way to specify or propagate a MessageGroupId.

This is similar to the limitation that exists with SNS to SQS standard queue integrations, where the MessageGroupId is not propagated between services. Even when using SNS FIFO topics, the MessageGroupId is not passed to Amazon SQS standard queues.

For now, if you need to use the fair queues feature, you would need to send messages directly to SQS with the MessageGroupId parameter set, rather than routing them through EventBridge targets.
Sources
Fanout Amazon SNS to Amazon SQS fair queues | AWS re:Post
Amazon SQS fair queues - Amazon Simple Queue Service
Building resilient multi-tenant systems with Amazon SQS fair queues | AWS Compute Blog

answered a year ago

0

As stated in the other answer, EventBridge does not support Fair Queues. However, we just released support for Fair Queues in SNS, so this may be a workaround for you.

AWS
EXPERT

answered a year ago

0

answered 8 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.