Redshift Serverless Zero-ETL options for RDS MS-SQL & S3, Redshift options for External API Get

0

Good day,

I am setting up a new environment with Redshift Serverless, 5 sources below I have been instructed not to use batch processing and wondering the best/simplest methods for ingest not using glue but redshift or python with mwaa dag jobs as resdhift schedular only executes sql scripts

  1. RDS MySQL > Using ZeroETL replication
  2. RDS PostgreSQL > Using ZeroETL replication
  3. RDS MS-SQL? DMS, not replicated but a batch job
  4. RDS S3? Redshift Spectrum, not replicated but a batch job.
  5. External API?

Please Any help will be much appreciated?

2 Antworten
0
Akzeptierte Antwort

Leveraging managed solutions wherever possible is certainly a good idea as frees you up from infrastructure heavy lifting and allows you to focus on achieving business goals. So you choosing Zero-ETL is a great decision. For sources not supported by Zero-ETL you can use DMS , example for MS-SQL. For S3 files in open format or table formats you can indeed leverage Redshift Spectrum to access the data in-place. And if your performance SLA's need faster access then you can consider S3 Auto-copy jobs to have the data automatically ingested into Redshift tables.

For #5 External API , I believe you will need to have some program that calls the API, obtains the data and decides what to do with it. Refer another re:Post Ingest data from a REST API and store into Redshift for handling this.

profile pictureAWS
beantwortet vor 2 Monaten
profile pictureAWS
EXPERTE
überprüft vor 2 Monaten
0

Thank You very much for your guidance, I'm on the right track :)

IC
beantwortet vor 2 Monaten

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen