Unable to fetch data from SQS queue.

Question

Despite 220k+ mesages in SQS  queue. I am unable to get messages from queue everytime I requests data.
Why is
> var response = SQS_Client.ReceiveMessage(SQS_ReceiveMessageRequest);

not returning data everytime I call receiveMessages function?

Leo K · Answer

If you're not getting an error message, then most likely, the messages have already been fetched but not deleted from the queue. They will only become visible again after the visibility timeout has expired: https://docs.aws.amazon.com/AWSSimpleQueueService/latest/SQSDeveloperGuide/sqs-visibility-timeout.html

I suggest you first check in your queue's metrics how many messages are visible.

On another note, to ensure you receive your messages, you should perform a long poll and preferably with the maximum wait time, if that's convenient: https://docs.aws.amazon.com/AWSSimpleQueueService/latest/SQSDeveloperGuide/sqs-short-and-long-polling.html. With a short poll, you aren't guaranteed to receive messages, particularly if only a small number of them is present. In this case, having hundreds of thousands of messages in the queue, this is very unlikely to be related to your immediate issue, however.

kranthi putti · Answer

Hello,

If you're unable to fetch messages from your SQS queue despite having 220k+ messages, try these steps:

**Visibility Timeout:**

* Messages might be fetched but not deleted, making them temporarily invisible. Check and adjust the visibility timeout.

**Long Polling:**

* Use long polling to increase the chances of receiving messages:

```
var receiveMessageRequest = new ReceiveMessageRequest
{
    QueueUrl = "YOUR_QUEUE_URL",
    WaitTimeSeconds = 20,  // Long polling
    MaxNumberOfMessages = 10 // Adjust as needed
};
var response = SQS_Client.ReceiveMessage(receiveMessageRequest);
```
**Delete Messages:**
* Ensure you delete messages after processing to prevent them from becoming invisible:

```
var deleteMessageRequest = new DeleteMessageRequest
{
    QueueUrl = "YOUR_QUEUE_URL",
    ReceiptHandle = "MESSAGE_RECEIPT_HANDLE"
};
SQS_Client.DeleteMessage(deleteMessageRequest);

```
**Check Permissions:**
* Verify that your SQS client has the necessary permissions to receive messages.

Uri Segev · Answer

Are you using a FIFO queue? If you are, could it be that all the messages have the same group ID and that there is another consumer reading messages from the queue? Are all consumers not receiving messages? What is the visibility timeout?

Unable to fetch data from SQS queue.

Add your answer

Relevant content