1 Answer
- Newest
- Most votes
- Most comments
2
Hello.
It may depend on the RDS database engine, but why not try using DMS?
https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Target.Redshift.html
The document below is an example for on-premises SQL Server, but I thought it might be possible to migrate data daily with a similar setup for RDS.
https://docs.aws.amazon.com/prescriptive-guidance/latest/patterns/migrate-an-on-premises-microsoft-sql-server-database-to-amazon-redshift-using-aws-dms.html
Relevant content
asked 3 years ago
I think testing is required, but it may be possible to output a CSV file from RDS to S3 and read the CSV with Redshift. https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/User.SQLServer.Options.S3-integration.html https://docs.aws.amazon.com/redshift/latest/dg/tutorial-loading-data.html
@jawuser, I agree with Riku: given your use case, I would really consider using DMS with Reshift as target. Best, Didier
Yes, I thought it would be the first option for me, but I was looking into AWS Glue as well. So now I'm trying to see if someone used that as well and which option would be better for my use case. We use MySQL DB and it needs to be replicated daily.
I think it is possible to move data from RDS to Redshift using Glue as well. For example, if you are planning to make major changes to the schema etc. when moving data from RDS to Redshift, it may be better to use Glue. If data conversion is not required, I think DMS is easier to set up. https://medium.com/@rozsedai/a-guide-from-rds-to-redshift-simplifying-data-migration-e3406368a069
It is also possible to set up the configuration as introduced in the blog below. https://aws.amazon.com/jp/blogs/big-data/stream-data-from-relational-databases-to-amazon-redshift-with-upserts-using-aws-glue-streaming-jobs/