Loading data from RDS to Redshift Direct
0
How to sync or load data from RDS to Redshift without S3 or Glue Job?
I need this solution support schedule load data and can know get logs for success or failed load data.
- Language
- English
asked 2 years ago1.5K views
1 Answer
- Newest
- Most votes
- Most comments
2
Here are three ways to get data from Amazon RDS to Amazon Redshift without using Amazon S3 or AWS Glue.
- Use Amazon Redshift's native Zero-ETL capability to replicate data from Amazon RDS to Amazon Redshift in near realtime. This is possible with a few steps in the Redshift and RDS console. No cost associated with this option, and performance is amazing.
- Use Amazon Redshift's native federated query capability to query the RDS instance directly from within Amazon Redshift. The desired schema in RDS is recreated as an external schema within Amazon Redshift and SQL queries can reference that external schema (and the tables it contains) as they would any other schema/table. This is possible with a few SQL statements. No cost associated with this option, and I think the performance is quite impressive for it being an SQL query over an external schema.
- Using the Database Migration Service to replicate data (including CDC) from RDS to Redshift. There is a cost associated with this for DMS usage and the hardware you select
answered 2 years ago
Relevant content
asked 3 years ago
asked 4 years ago
asked 2 years ago
First Solution can support RDS MySQL or Need Aurora ?
Yes, the first solution of Zero-ETL supports Aurora MySQL, Aurora PostGres, Amazon RDS MySQL, and Amazon DynamoDB (preview) as source databases replicating to Amazon Redshift
Great but for first solution can schedule load data and how to know get logs for success or failed load data.
There isn't scheduling required, any changes in RDS are replicated automatically to Redshift in near realtime. The RDS and Redshift consoles provide insight into the health of the replication and there are other Redshift logging data available if I remember correctly, but best to check the Zero-ETL documentation.