eventbridge pipe SQS polling frequency

Question

I have an eventBridge pipe that has SQS as the source.  It currently polls the queue 10s of thousands of times a day.  Am I able to reduce the polling frequency to something like once a minute?

Accepted Answer

No. You can't control the rate. EventBridge Pipes polls the queue in a continues manner using long polling with 20 seconds wait (the poller makes a Receive Messages call, passing a wait time of 20 seconds and if there are no messages, the call waits up to 20 seconds for messages to arrive). This means that each poller makes 3 calls per minute to get messages from the queue when there are no messages. If there are messages, it does it more frequently. We start with 5 pollers.

You can find more information here.

You can find more information [here](https://docs.aws.amazon.com/eventbridge/latest/userguide/eb-pipes-sqs.html#pipes-sqs-scaling).

Answer

A pipe in STARTED state continuously polls for events from the source, scaling up and down depending on the available backlog and configured batching settings. EventBridge polls the queue and invokes your pipe synchronously with an event that contains queue messages. EventBridge reads messages in batches and invokes your pipe once for each batch. When your pipe successfully processes a batch, EventBridge deletes its messages from the queue. By default, EventBridge polls up to 10 messages in your queue simultaneously and sends that batch to your pipe. To avoid invoking the pipe with a small number of records, you can tell the event source to buffer records for up to five minutes by configuring a batch window.

eventbridge pipe SQS polling frequency

Relevant content