DMS from Aurora to Redshift

0

Customer has the following requirements.

  1. Getting new patient data file into S3 bucket.
  2. Loading patient data file into Aurora.
  3. Filtering rows based on criteria and storing them in separate file to place it in S3 bucket.
  4. Loading the selected records into Redshift which in turn will be visible through QuickSight.

In order to automate this process, we are making use of Lambda functions where in – a. Client will place new file in to S3 bucket. b. This will trigger Lambda function which will load this file into Aurora c. Using filtration criteria selected rows will be copied into new file. This file will be placed into S3 bucket d. A new Lambda function will load this file into Redshift.

I was thinking about using DMS to directly replicate the data from Aurora into Redshift. Is this possible? is there any model or use case available to validate this? If no, is there any advise on how to achieve this from the DB perspective?

已提问 7 年前1016 查看次数
1 回答
0
已接受的回答

DMS supports both Aurora as a source and Redshift as a target. When using Redshift as a target, DMS uses an intermediate S3 bucket, where changes are stored before they are loaded into Redshift. The size of the file that triggers a load into Redshift can be customized as specified in http://docs.aws.amazon.com/dms/latest/userguide/CHAP_Introduction.ConnectionAttributes.html#CHAP_Introduction.ConnectionAttributes.Redshift

AWS
已回答 7 年前

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则