NextToken from ExecuteStatement returns error "NextToken does not match request" in Lambda function

Question

Running into issue with [ExecuteStatement](https://docs.aws.amazon.com/amazondynamodb/latest/APIReference/API_ExecuteStatement.html).  The result returned both "LastEvaluatedKey" and "NextToken" but when we fed it into the next "ExecuteStatement" as part of "input", we keep getting an error "NextToken does not match request".

```
const input = { Statement: '...', Parameter: [...] };
let end = false;
let nextInput = input;
while (!end) {
const { LastEvaluatedKey, NextToken, ...rest } =
  await new ExecuteStatementCommand(nextInput);
LastEvaluatedKey === undefined ?
  end = true :
  nextInput = { NextToken, ...input };
}
```

Saw this other [question regarding LastEvaluatedKey](https://www.repost.aws/questions/QUgNPbBYWiRoOlMsJv-XzrWg/how-to-use-last-evaluated-key-in-execute-statement-request) which was helpful.
However, the proposed solution does not work as our key value is date based (i.e. pulling data based on a date range). So, the query result ended with numerous duplicate items created on same date.

Answer

To JaccoPK, `ExclusiveKeyStart` is not an input for `ExecuteStatementCommand` unfortunately.

Answer

I found this error on my application, after some debugging I found it was due to the query statement being built in a different order even though the filters are the same, example:

SELECT * FROM "SomeTable"."valueOneGSI" where "valueOne" = 'someValue' AND "valueTwo" IS MISSING AND "valueThree" = 'someOtherValue'

vs

SELECT * FROM "SomeTable"."valueOneGSI" where "valueOne" = 'someValue' AND "valueThree" = 'someOtherValue' AND "valueTwo" IS MISSING

In my case it happened because I was receiving the filters in the body but the order was changed due to NextToken field being included in subsequent requests, so I just made sure to always add the AND clauses in alphabetical order and it's working properly now.

NextToken from ExecuteStatement returns error "NextToken does not match request" in Lambda function

Contenido relevante