Athena to Timestream Connector problem

Question

Hi

I have configured the Athena with a data source to query data from Timestream tables. It created the Lambda function as a connector.
![Athena Datasource](/media/postImages/original/IMIOvZ59B5Sc2CtAo9A6E1oA)
![Lambda as connector](/media/postImages/original/IMRsCUVl9oQyG257e26TZRbg)
The Lambda function uses a role that has all the permissions.
![Permissions](/media/postImages/original/IMKalB4MlrT8aLO7JwcuqDag)

But, eventually I am getting the following error when querying the timeseries db table from Athena.
![Athena query](/media/postImages/original/IM-FHjINv3TxqtYmz3gVT9cw)

GENERIC_USER_ERROR: Encountered an exception[java.lang.RuntimeException] from your LambdaFunction[arn:aws:lambda:eu-central-1:289301669695:function:timestream-catalog] executed in context[retrieving meta-data] with message[spill_bucket: "tspill" not found under your account. Please make sure you have access to the bucket and spill_bucket input has no trailing '/']

Appreciate if you can help please. It does not seem to access to the spill bucket (tspill) provided when the Lambda connector is configured. But it has all the permissions to access to S3 to create it. What am I missing?

Thanks
CK

Answer

Hello, thank you for reaching out.

This error signifies that there is no bucket named “timestreamspill” under your account to be used as spill_bucket.

SpillBucket is an Amazon S3 bucket in your account to store data that exceeds Lambda function response size limits.

Note, that this bucket does not get created automatically when you use the default Lambda connector.

To solve the error, you will have to edit the Lambda function and add an existing bucket name in the parameter spill_bucket.  You can do this in 2 ways:

- Create a new S3 bucket [1] and then mention its name in spill_bucket parameter, or
- Use an already existing bucket name in spill_bucket parameter.

Ref.:
[1] https://docs.aws.amazon.com/AmazonS3/latest/userguide/create-bucket-overview.html

The above information will provide you with details to triage the issue. However, please note this is general guidance only. In order to understand the issue fully, we require details that are non-public information. Please open a support case with AWS using the following link.

As always, Happy Cloud Computing.

Athena to Timestream Connector problem

Relevant content