Redshift Serverless Zero-ETL options for RDS MS-SQL & S3, Redshift options for External API Get

0

Good day,

I am setting up a new environment with Redshift Serverless, 5 sources below I have been instructed not to use batch processing and wondering the best/simplest methods for ingest not using glue but redshift or python with mwaa dag jobs as resdhift schedular only executes sql scripts

  1. RDS MySQL > Using ZeroETL replication
  2. RDS PostgreSQL > Using ZeroETL replication
  3. RDS MS-SQL? DMS, not replicated but a batch job
  4. RDS S3? Redshift Spectrum, not replicated but a batch job.
  5. External API?

Please Any help will be much appreciated?

2回答
0
承認された回答

Leveraging managed solutions wherever possible is certainly a good idea as frees you up from infrastructure heavy lifting and allows you to focus on achieving business goals. So you choosing Zero-ETL is a great decision. For sources not supported by Zero-ETL you can use DMS , example for MS-SQL. For S3 files in open format or table formats you can indeed leverage Redshift Spectrum to access the data in-place. And if your performance SLA's need faster access then you can consider S3 Auto-copy jobs to have the data automatically ingested into Redshift tables.

For #5 External API , I believe you will need to have some program that calls the API, obtains the data and decides what to do with it. Refer another re:Post Ingest data from a REST API and store into Redshift for handling this.

profile pictureAWS
回答済み 2ヶ月前
profile pictureAWS
エキスパート
レビュー済み 2ヶ月前
0

Thank You very much for your guidance, I'm on the right track :)

IC
回答済み 2ヶ月前

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン

関連するコンテンツ