By using AWS re:Post, you agree to the Terms of Use

Best services for client data upload, data cleaning, ingestion into RDS

0

I'm having trouble figuring out the best AWS service/services for a scenario where a client uploads a .csv file, then these data are cleaned and ingested into RDS using and R script. FTP and code pipeline? Any suggestions?

1 Answer
2

Is this CSV a custom one or some database backup etc. ? Assuming that its former, then is R a mandate requirement to use? One quick option would be to use AWS Glue which can be used to do your ETL. The source of CSV can be S3. Glue automatically generates Scala or Python code for your ETL jobs that you can further customize using tools you are already familiar with.

profile picture
answered 13 days ago
profile picture
MODERATOR
reviewed 13 days ago
  • That's very helpful. Thank you. It is a custom CSV. I will look into Glue right now!

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions