How can I make SQS send message as a batch instead of seprately

0

I have a lambda function called service A in 5 different region, and when they are sending a message at the same time together, my lambda function called service B cannot receieve the message as a batch, but it received the message in seprate call , How can I achieve if service B can surely get the 5 message from lambda service A at one time instead of seprately getting them

Below is my code of SQS and lambda code set up

   const queue = new Queue(this, 'SqsQueue', {

            receiveMessageWaitTime: Duration.seconds(20),
            visibilityTimeout: Duration.seconds(300)

        })


        queue.grantSendMessages(role)


        const readSqsFn = new NodejsFunction(this, 'send', {
            timeout: Duration.seconds(30),
            reservedConcurrentExecutions: 1
        })



        const sesPolicy = new aws_iam.PolicyStatement({
            actions: ["ses:SendEmail",
                "ses:SendRawEmail"],
            effect: aws_iam.Effect.ALLOW,
            resources: ['*']

        })

        readSqsFn.addToRolePolicy(sesPolicy)


        queue.grantConsumeMessages(readSqsFn)

        readSqsFn.addEventSource(new SqsEventSource(queue, {
            batchSize: 10
        }))
export const handler = async (
    event: SQSEvent,
    context: any = {}
): Promise<any> => {


 

    console.log(event.Records)
    for (const record of event.Records) {

        console.log('sqs record:', record?.body);




    }




};
RECJ
已提問 6 個月前檢視次數 296 次
1 個回答
0
已接受的答案

If you configure a Lambda trigger from SQS, you can configure a batch size, and you can also configure a window size. The batch size indicates what is the maximum number of messages that your function will receive in each invocation and the window size indicates how long to wait until the batch gets full. If you do not specify a window size, your function will be invokes as soon as there will be messages in the queue.

profile pictureAWS
專家
Uri
已回答 6 個月前
profile picture
專家
已審閱 1 個月前
  • Thank you for your help!! it works! I set the window to 60 seconds and batch = 5 in my read sqs lambda function(Service B), since my lambda(Service A) is deployed in 5 different regions and when the message need to be sent from the SQS to the service B, now 4 records will be group together and send, and then the left 1 will be sent seprately , and sometimes 3 records will be grouped together and then the another 2 records are also group together then send from the SQS to the Service B, I wonder if it is impossible to guarantee that exactly 5 records, do not seprate any of those, can get from SQS and send to the Service B

  • Because of the distributed nature of SQS and the fact that you have very low number of messages, you can't guarantee this. If you will send a larger number of messages, most invocations will include the 5 records.

    Did not try it, but if you switch to a FIFO queue, and use the same messgae group ID for all messages you send into the queue, it may also work.

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南