Redshift Serverless Zero-ETL options for RDS MS-SQL & S3, Redshift options for External API Get

0

Good day,

I am setting up a new environment with Redshift Serverless, 5 sources below I have been instructed not to use batch processing and wondering the best/simplest methods for ingest not using glue but redshift or python with mwaa dag jobs as resdhift schedular only executes sql scripts

  1. RDS MySQL > Using ZeroETL replication
  2. RDS PostgreSQL > Using ZeroETL replication
  3. RDS MS-SQL? DMS, not replicated but a batch job
  4. RDS S3? Redshift Spectrum, not replicated but a batch job.
  5. External API?

Please Any help will be much appreciated?

2 Answers
0
Accepted Answer

Leveraging managed solutions wherever possible is certainly a good idea as frees you up from infrastructure heavy lifting and allows you to focus on achieving business goals. So you choosing Zero-ETL is a great decision. For sources not supported by Zero-ETL you can use DMS , example for MS-SQL. For S3 files in open format or table formats you can indeed leverage Redshift Spectrum to access the data in-place. And if your performance SLA's need faster access then you can consider S3 Auto-copy jobs to have the data automatically ingested into Redshift tables.

For #5 External API , I believe you will need to have some program that calls the API, obtains the data and decides what to do with it. Refer another re:Post Ingest data from a REST API and store into Redshift for handling this.

profile pictureAWS
answered 2 months ago
profile pictureAWS
EXPERT
reviewed 2 months ago
0

Thank You very much for your guidance, I'm on the right track :)

IC
answered 2 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions