DMS from Aurora to Redshift

0

Customer has the following requirements.

  1. Getting new patient data file into S3 bucket.
  2. Loading patient data file into Aurora.
  3. Filtering rows based on criteria and storing them in separate file to place it in S3 bucket.
  4. Loading the selected records into Redshift which in turn will be visible through QuickSight.

In order to automate this process, we are making use of Lambda functions where in – a. Client will place new file in to S3 bucket. b. This will trigger Lambda function which will load this file into Aurora c. Using filtration criteria selected rows will be copied into new file. This file will be placed into S3 bucket d. A new Lambda function will load this file into Redshift.

I was thinking about using DMS to directly replicate the data from Aurora into Redshift. Is this possible? is there any model or use case available to validate this? If no, is there any advise on how to achieve this from the DB perspective?

1개 답변
0
수락된 답변

DMS supports both Aurora as a source and Redshift as a target. When using Redshift as a target, DMS uses an intermediate S3 bucket, where changes are stored before they are loaded into Redshift. The size of the file that triggers a load into Redshift can be customized as specified in http://docs.aws.amazon.com/dms/latest/userguide/CHAP_Introduction.ConnectionAttributes.html#CHAP_Introduction.ConnectionAttributes.Redshift

AWS
답변함 7년 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠