Skip to content

Aurora Serverless v2 can't access s3Import credentials on resume

0

I have an Aurora Serverless v2 instance running PostgresSQL 16.4 which is set to reduce to 0 ACU after 5minutes. I've setup the instance so it has s3Import via it's IAM role.

Often when the cluster resumes from 0 it cannot load data from S3 and I have to remove and readd the IAM role and s3Import feature. Simple deleting and readding the role in the console solves the problem.

Has anyone experienced this problem?

Here is the error message: The credentials stored with the database instance can’t be accessed. Make sure that the desired Amazon Resource Name (ARN) is associated with the feature-name: s3Import.

  • Is there any update on this? I also have trouble using s3Import/s3Export roles after a serverless cluster goes idle.

  • Hi David, we have paused this project so I haven't had a chance to explore it. It will likely get picked up next month so I can see if things have improved.

2 Answers
0

I think, but I'm not certain, that removing the

# Terraform
Condition = {
  StringEquals = {
    "aws:SourceArn" : "<ARN>"
  }
}

solved the problem for us. It was on a different DB, the one I referenced here was stopped when we stopped the project.

Again, I haven't done extensive testing, we haven't used this feature as much as we expected, but I suspect ARN of the DB was some how referencing a different internal ID. Much like if you delete and recreate an IAM role with the same name the ID the name references has changed. And, old references to the role need to be refreshed. My suspicion is that something like that is happening with the DB ARN. The resume of the cluster means a new resource ID is associated with the previous source ARN. As a simple readd of the same policy works, probably updating some internal, hidden links. The counter argument to that is why would AWS allow this bug to persist for so long in the docs.

:shrug:

answered 6 months ago

-3

To mitigate this issue, please consider increasing the minimum capacity and instead of setting it to 0, set a low but non-zero value (e.g., 0.5) to prevent complete pausing.

AWS

answered 2 years ago

  • Yes, I can do this but it's a dev instance which can be unused for most of a month and it is a real cost benefit to having it scale to zero. I'd rather understand what's causing the problem and fix it.

  • Apologies, did not mean this to be an ultimate solution, was just curious to know if this works or not. I am looking into potential causes, will get back to you once I have some ideas.

  • Is there any update on this? I also have trouble using s3Import/s3Export roles after a serverless cluster goes idle.

  • @Vardan Matevosyan Any updates? Same issue here! Very disappointing from AWS..

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.