Dynamodb scan bug

DynamoDB has a maximum page size of 1MB:

A single Scan operation reads up to the maximum number of items set (if using the Limit parameter) or a maximum of 1 MB of data and then apply any filtering to the results using FilterExpression

This means that you requests reads up to 1MB of data, then applies the filter, then returns you the response. In order to retrieve the full set of results, you must use Pagination

To satisfy yourself with my answer, try the request using the CLI, it will automatically paginate so will provide you with the response you expect.

aws dynamodb scan \
    --table-name activations \
    --filter-expression "txn = :a" \
    --expression-attribute-values '{":a":{"S":"your tx id here"}}

Hi,

In second screenshot you can see the message that you need to click “continue search” to find all items.

This could be a related to dynamo scan reaching 1mb data in response https://docs.aws.amazon.com/amazondynamodb/latest/APIReference/API_Scan.html

Check if LastEvaluatedKey is present in the response, and if so, you need to paginate the result set.

Lee is always on the mark. Just wanted to add that the console makes its own choices and doesn't necessarily track to the defaults for the API. Yes, that sucks.

Hi, thanks for the answers - got this working. thx