AWS Redshift Serverless execute Python script to API Call within a function/stored procedure to be query scheduled

0

Hi,

Setting up a zero code ETL environment using Redshift mostly I will be setting up Scheduler to ingest data from FDW RDS but for API I would like a SP/Function to execute Python scripts that do an API call and write a destination to the redshift table that can be query editor v2 scheduled?

Please Help

Regards

2개 답변
0

To set up a zero code ETL environment to ingest data from an API into Redshift using Lambda, here is what you can do: -Create a Lambda function using Python runtime. The function code should make an API call, parse the response and insert the data into a Redshift table. -Grant the Lambda execution role permissions to call the API, insert into Redshift and any other dependent services. -Create an API Gateway REST API and integrate it with the Lambda function using Lambda proxy integration. -Configure the API Gateway stage for public access. -Schedule the API Gateway endpoint URL using EventBridge or CloudWatch Events to trigger the Lambda function on a periodic basis.

This allows ingesting API data into Redshift in a serverless manner without having to write any ETL code. The API Gateway endpoint acts as the trigger that executes the Lambda function which fetches data and loads it into Redshift.

profile picture
전문가
답변함 3달 전
0

Thank You for assisting.

Can you kindly provide links/example to follow the setup?

IC
답변함 3달 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠