Public Rest API to S3

0

I am new to AWS , I would like to know the easiest method to move data from a public APi such as Data.gov to an S3 bucket for further analysis . I am familiar with Aws services such as Glue and AppFlows but they don’t seem suited to pull data from a custom rest api endpoint .

1 Answer
1
Accepted Answer

If you want to simply fetch the data from the API and write it to S3, this can be done with Lambda Functions. You could then set up EventBridge to trigger your Lambda Function at a predefined schedule, allowing you to poll the API periodically.

However if your workflow has more complex steps or involves long-running processes, you might want to look into other services like AWS Step Functions or AWS Batch.

Chamal
answered a year ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions