- Newest
- Most votes
- Most comments
The issue you're experiencing with your RDS snapshot export to S3 getting stuck at 99% is not uncommon and can be caused by several factors. Here are some insights and suggestions to help you address this situation:
-
Export process timing: The export process can take a while depending on your database type and size. Even though your database is relatively small at ~60 GB, the export task first restores and scales the entire database before extracting the data to Amazon S3. During this phase, the task's progress may display as "Starting" and then switch to "In progress" when it begins exporting data to S3.
-
Data characteristics: The time it takes for the export to complete depends on the data stored in the database. Tables with well-distributed numeric primary key or index columns export the fastest, while tables without suitable columns for partitioning or with only string-based index columns can take longer. This is because the export may use a slower single-threaded process for such tables.
-
Monitoring options: You can monitor the export process using the AWS Management Console, AWS CLI, or RDS API. The AWS CLI command 'describe-export-tasks' can provide detailed information about the export task, including its status, progress percentage, and any warning messages.
-
Parquet files in S3: The fact that you can see the exported Parquet files in your S3 bucket is a good sign. It suggests that the data export has likely completed, but the task status may not have updated correctly.
-
Waiting vs. action: There isn't a specific time limit for export tasks, but waiting for 5 days is excessive. At this point, you may want to consider canceling the current export task and initiating a new one.
-
Troubleshooting steps:
- Check the CloudWatch logs for your Lambda function to ensure it's not encountering any errors.
- Verify that the IAM role used for the export has the necessary permissions.
- Ensure that your S3 bucket is in the same region as your RDS instance.
- Check if there are any ongoing AWS service issues in your region.
- Alternative approach: If the issue persists, you might want to consider using AWS Database Migration Service (DMS) as an alternative method to export your RDS data to S3.
If the problem continues after trying these suggestions, it would be advisable to contact AWS Support for further assistance, as they can provide more detailed diagnostics and potential solutions specific to your account and setup.
Sources
Exporting DB snapshot data to Amazon S3 for Amazon RDS - Amazon Relational Database Service
Monitoring snapshot exports for Amazon RDS - Amazon Relational Database Service
Relevant content
asked 9 months ago
asked 3 years ago
