Redshift Serverless Zero-ETL options for RDS MS-SQL & S3, Redshift options for External API Get

0

Good day,

I am setting up a new environment with Redshift Serverless, 5 sources below I have been instructed not to use batch processing and wondering the best/simplest methods for ingest not using glue but redshift or python with mwaa dag jobs as resdhift schedular only executes sql scripts

  1. RDS MySQL > Using ZeroETL replication
  2. RDS PostgreSQL > Using ZeroETL replication
  3. RDS MS-SQL? DMS, not replicated but a batch job
  4. RDS S3? Redshift Spectrum, not replicated but a batch job.
  5. External API?

Please Any help will be much appreciated?

2 個答案
0
已接受的答案

Leveraging managed solutions wherever possible is certainly a good idea as frees you up from infrastructure heavy lifting and allows you to focus on achieving business goals. So you choosing Zero-ETL is a great decision. For sources not supported by Zero-ETL you can use DMS , example for MS-SQL. For S3 files in open format or table formats you can indeed leverage Redshift Spectrum to access the data in-place. And if your performance SLA's need faster access then you can consider S3 Auto-copy jobs to have the data automatically ingested into Redshift tables.

For #5 External API , I believe you will need to have some program that calls the API, obtains the data and decides what to do with it. Refer another re:Post Ingest data from a REST API and store into Redshift for handling this.

profile pictureAWS
已回答 2 個月前
profile pictureAWS
專家
已審閱 2 個月前
0

Thank You very much for your guidance, I'm on the right track :)

IC
已回答 2 個月前

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南