Redshift Serverless Zero-ETL options for RDS MS-SQL & S3, Redshift options for External API Get

0

Good day,

I am setting up a new environment with Redshift Serverless, 5 sources below I have been instructed not to use batch processing and wondering the best/simplest methods for ingest not using glue but redshift or python with mwaa dag jobs as resdhift schedular only executes sql scripts

  1. RDS MySQL > Using ZeroETL replication
  2. RDS PostgreSQL > Using ZeroETL replication
  3. RDS MS-SQL? DMS, not replicated but a batch job
  4. RDS S3? Redshift Spectrum, not replicated but a batch job.
  5. External API?

Please Any help will be much appreciated?

2개 답변
0
수락된 답변

Leveraging managed solutions wherever possible is certainly a good idea as frees you up from infrastructure heavy lifting and allows you to focus on achieving business goals. So you choosing Zero-ETL is a great decision. For sources not supported by Zero-ETL you can use DMS , example for MS-SQL. For S3 files in open format or table formats you can indeed leverage Redshift Spectrum to access the data in-place. And if your performance SLA's need faster access then you can consider S3 Auto-copy jobs to have the data automatically ingested into Redshift tables.

For #5 External API , I believe you will need to have some program that calls the API, obtains the data and decides what to do with it. Refer another re:Post Ingest data from a REST API and store into Redshift for handling this.

profile pictureAWS
답변함 2달 전
profile pictureAWS
전문가
검토됨 2달 전
0

Thank You very much for your guidance, I'm on the right track :)

IC
답변함 2달 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인