Uploading files to s3

Question

How to upload file directly to s3 from web. For example uploading imagenet data from the website to the s3 after extracting the tar file of it, without downloading dataset into my system, all process should be done through cloud. Do we need to use lambda or any other way to do it. ?

Antonio_Lagrotteria · Answer

Hi,

answer is depends :)

If you are using a Javascript framework such as React/Angular/Next, you may want to look into Amplify. There is a pretty neat component that allows you to upload seamlessly files to s3: https://ui.docs.amplify.aws/react/connected-components/storage/storagemanager

Other options involve:
* Expose an api via API Gateway direct integration towards S3 to do upload, as direct proxy
* For large files you may need to use API Gateway with signed URLS
* A combination of Cloud front and Lambda@Edge

You can find details here: https://aws.amazon.com/blogs/compute/patterns-for-building-an-api-to-upload-files-to-amazon-s3/

Hope it helps ;)

Kem · Answer

Following up this question, I have a link of a web address. When I click on it, it automatically downloads a .tgz file. Is there a way to upload that .tgz file (or the .png files that are inside of that .tgz file) straight to an S3 bucket?

Uploading files to s3

Relevant content