Boto3 client.get_log_events() returns an empty list, but a list of log events is viewable in the AWS console

Question

We have a server that runs this piece of code:

```
        region = settings.AWS_REGION
        client = boto3.client('logs', region_name=region)
        
        job_id = 'xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx'
        response = client.get_log_events(
            logGroupName=f'/proprietary/log/group/name',
            logStreamName=job_id,
            startTime=0,
            startFromHead=False,  # the latest log events are returned first.
        )
```

The response is sometimes, but not always, empty. An example of an empty response is:
```
{'events': [], 'nextForwardToken': 'f/xxxxxxxx/s', 'nextBackwardToken': 'b/xxxxxxxx/s', 'ResponseMetadata': {'RequestId': 'xxxxxxxx', 'HTTPStatusCode': 200, 'HTTPHeaders': {'x-amzn-requestid': 'xxxxxxxx, 'content-type': 'application/x-amz-json-1.1', 'content-length': 'xxxxxxxx', 'date': 'Fri, 13 Oct 2023 14:55:41 GMT'}, 'RetryAttempts': 0}}
```
However, if I go to the log group and stream name associated with /proprietary/log/group/name and job_id, I do see a stream of results.

Other posts suggested running this code
```
list_resp = client.list_metrics()
```
but it's not available to run with the client

Another post suggested It's a permissions issue. But I'm using the same permissions to view the log stream in AWS console as I'm using to run this code.

Is the code wrong or is this a bug?

Answer

Hi,

if the nextForwardToken is not null, maybe you should try calling the get_log_events API again and pass it the token?
According to the API doc https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/logs/client/get_log_events.html, "This operation can return empty results while there are more log events available through the token."

Boto3 client.get_log_events() returns an empty list, but a list of log events is viewable in the AWS console

Relevant content