RDS SQL to RDS SQL regular copy

0

Currently using DMS Full Load + Replication for this, but looking for an alternative if cost becomes a problem.

If it were not on RDS I'd be using SSIS or Server Agent. We have a production SQL database that I want to push to a data warehouse on a regular basis (nightly at minimum). I am not our org's AWS person...just a data engineer who has gotten familiar with AWS over a few years. I assume I can do a scheduled DMS task for Full Load via EventBridge. Is there another way to do this that I'm forgetting, which would be less costly than our ongoing replication setup?

1 Answer
0

Yes, there are alternative methods to migrate data from one RDS SQL Server instance to another that could potentially be more cost-effective than using AWS Database Migration Service (DMS) with continuous replication. Here are a few options to consider:


  1. Copying transaction log backups: To copy a set of available transaction log backups for an individual database to your Amazon S3 bucket, call the rds_tlog_backup_copy_to_S3 stored procedure. The rds_tlog_backup_copy_to_S3 stored procedure will initiate a new task to copy transaction log backups. https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER.SQLServer.AddlFeat.TransactionLogAccess.Copying.html

  2. Set up a cross-region disaster recovery site for Amazon RDS for SQL Server: AWS DMS performs this ongoing replication activity using SQL Server’s MS-CDC feature. MS-CDC in SQL Server is an Enterprise edition-only feature until SQL Server 2016 RTM. Starting with SQL Server 2016 SP1, MS-CDC is also supported in standard editions of SQL Server. https://aws.amazon.com/blogs/database/set-up-a-cross-region-disaster-recovery-site-for-amazon-rds-for-sql-server/

  3. Using Microsoft SQL Server Integration Services on Amazon RDS for SQL Server: You can now configure Microsoft SQL Server Integration Services (SSIS) on Amazon Relational Database Service (RDS) for SQL Server. SSIS works on Single-AZ and Multi-AZ DB instances for both Standard and Enterprise editions using either the 2016 or 2017 SQL Server major versions. https://aws.amazon.com/blogs/database/using-microsoft-sql-server-integration-services-on-amazon-rds-for-sql-server/

  4. Native SQL Server Backup and Restore: This is often the most straightforward and efficient method for homogeneous migrations between SQL Server instances. You can create a backup of your source database and restore it to the target RDS instance. This method can be scheduled and automated using AWS services like EventBridge in combination with AWS Lambda or AWS Systems Manager. Using .bak files to backup databases is heavily optimized, and is usually the fastest way to export data.

Please go through the below document to understand about this in detail:
 https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/SQLServer.Procedural.Importing.html

AWS
SUPPORT ENGINEER
answered 6 days ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions