DMS from Aurora to Redshift

0

Customer has the following requirements.

  1. Getting new patient data file into S3 bucket.
  2. Loading patient data file into Aurora.
  3. Filtering rows based on criteria and storing them in separate file to place it in S3 bucket.
  4. Loading the selected records into Redshift which in turn will be visible through QuickSight.

In order to automate this process, we are making use of Lambda functions where in – a. Client will place new file in to S3 bucket. b. This will trigger Lambda function which will load this file into Aurora c. Using filtration criteria selected rows will be copied into new file. This file will be placed into S3 bucket d. A new Lambda function will load this file into Redshift.

I was thinking about using DMS to directly replicate the data from Aurora into Redshift. Is this possible? is there any model or use case available to validate this? If no, is there any advise on how to achieve this from the DB perspective?

1回答
0
承認された回答

DMS supports both Aurora as a source and Redshift as a target. When using Redshift as a target, DMS uses an intermediate S3 bucket, where changes are stored before they are loaded into Redshift. The size of the file that triggers a load into Redshift can be customized as specified in http://docs.aws.amazon.com/dms/latest/userguide/CHAP_Introduction.ConnectionAttributes.html#CHAP_Introduction.ConnectionAttributes.Redshift

AWS
回答済み 7年前

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン

関連するコンテンツ