Redshift vs Redshift Serverless FDW Query & NoETL (RDS Microsoft SQL)

0

Good Day, I need help, please. I am setting up a new DW/analytics reporting environment using AWS Airflow with Python and Redshift Serverless

  1. For NoETL from RDS PostgreSQL/MySQL to Redshift Serverless, I require clarity on setting up Federated Queries work for the Serverless version for setting up external schema across accounts? (Only find content for Redshift)
  2. For NoETL FDW federated query, external schema with RDS Microsoft SQL does not seem to have the option for serverless?

Regards

IC
asked 2 months ago116 views
3 Answers
0
Accepted Answer

Hi,

  1. I found the below link which clarifies Federated queries from Serverless to RDS Source https://docs.aws.amazon.com/redshift/latest/mgmt/serverless-considerations.html

  2. Options on how to Federated Query from Serverless to RDS MS-SQL, I'm really looking for a simple architecture and not multiple ETL for RDS MS-SQL only. Are there upgrades that perhaps occurred on this issue or other ways to query across account from Serverless to RDS MS-SQL?

Regards

IC
answered 2 months ago
0

Hi,

on your 2., Redshift Serverless has a generic approach (so working also for MS SQL Server) via JDBC drivers across all rdms: see https://docs.aws.amazon.com/redshift/latest/mgmt/serverless-connecting.html

This approach will also solve your 1. though ad hoc connection definition.

Best,

Didier

profile pictureAWS
EXPERT
answered 2 months ago
0

Thank You for assisting Didier_Durand

  1. Unfortunately, what I meant was that I don't see an FDW option for RDS MS-SQL to setup an external schema with Serverless to source RDS MS-SQL I am kind of a one-man team and am trying to setup a low code space with AWS Airflow triggering a python script that triggers a redshift Stored Proc for ETL between source & serverless destination.

Please let me know if there are better methods.

IC
answered 2 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions