Skip to content

Multiple Redshift Serverless Workgroups Stuck in CREATING State for 8+ Hours

0

Issue Description We have multiple Redshift Serverless workgroups stuck in CREATING state for over 8 hours in eu-west-2. The interesting part is:

  1. One workgroup (let's call it workgroup-A) shows:
  • Status: CREATING
  • Has a VPC endpoint with ENI in eu-west-2b
  • ENI is properly created and visible
  • But workgroup won't progress beyond CREATING state
  1. Configuration Details:
  • Region: eu-west-2
  • Enhanced VPC routing: enabled
  • Multi-AZ setup with 3 subnets
  • Security groups properly configured
  • Using requester-managed VPC endpoints
  1. Attempted Solutions:
  • Waited well beyond normal creation time (5-7 minutes)
  • Verified no VPC/subnet issues
  • Confirmed proper IAM permissions
  • Logging shows no obvious errors
  • Force delete (can't find the relevant aws cli)
  • Kill services (AWS requester managed)
  1. Technical Details:
  • Workgroups have been in CREATING state for ~10 hours
  • VPC endpoints are created but workgroups won't progress
  • No error messages in CloudWatch logs

Questions:

  1. Is there a known issue with Redshift Serverless workgroup creation getting stuck?
  2. Are there any CLI commands to force clean-up of stuck workgroups?
  3. What's the recommended approach when workgroups get stuck in CREATING state?
1 Answer
1

While there are no known widespread issues with Redshift Serverless workgroup creation getting stuck, the situation you're experiencing is certainly unusual and concerning. Here are some insights and recommendations based on the information provided:

  1. Stuck workgroup creation: This is not a common occurrence, but it can happen due to various reasons such as network configuration issues, resource constraints, or temporary service disruptions.

  2. Force clean-up: Unfortunately, there isn't a straightforward CLI command to force clean-up of stuck workgroups. Amazon Redshift Serverless manages the infrastructure, which limits direct intervention options.

  3. Recommended approach:

    a. Contact AWS Support: Given the extended duration of the issue and the lack of visible errors, it's advisable to open a support ticket with AWS. They can investigate backend issues that might not be visible to you.

    b. Review VPC and subnet configuration: Ensure that your VPC and subnets meet all requirements for Redshift Serverless. This includes having at least three subnets across three Availability Zones.

    c. Check IAM permissions: Verify that the IAM role associated with your Redshift workgroup has the necessary permissions, including full access to Redshift Serverless resources.

    d. Attempt creation in a different VPC: If possible, try creating a new workgroup in a different VPC to isolate whether the issue is specific to your current VPC configuration.

    e. Monitor CloudWatch Logs: Continue monitoring CloudWatch logs for any new error messages or indications of the root cause.

    f. Consider using SQL commands: If you have access to the Redshift query editor, you might try creating the database using SQL commands instead of the UI. This could potentially bypass any UI-related issues.

If the issue persists after trying these steps, waiting for AWS Support's intervention might be necessary. They have access to more detailed logs and can perform actions that are not available to customers.

Remember that Redshift Serverless is designed to handle most infrastructure management automatically, which is why there are limited options for manual intervention in such scenarios.

Sources
Redshift Serverless - unable to create a database - ERROR: permission denied to create database | AWS re:Post
Unable to Create Redshift Serverless due to Workgroup in Preview State & requires 3 avail zone subnets | AWS re:Post

answered 2 years ago

EXPERT

reviewed 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.