Ingest data from a REST API and store into Redshift

0

We have a use case where we need to retrieve data from an external system using a REST API interface and store it into Redshift. The volume of data is expected to be quite small and the process needs to run on a schedule, once a day.

What tools and architecture is recommended for this?

Thanks!

1 Answer
1
Accepted Answer

Hi,

I would reccomend the following:

If you want to have separated lambdas for retrieving data and store data to redshift, you could consider to use step function with 2 states, one for each lambda (retrieve data and store to redshift).

This link contains part of what you are trying to accomplish: https://aws.amazon.com/blogs/big-data/building-an-event-driven-application-with-aws-lambda-and-the-amazon-redshift-data-api/

Hope it helps ;)

profile picture
EXPERT
answered a year ago
  • Thank you so much, this is very helpful.

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions