FTP to S3 bucket

0

What is the best way to transfer files from FTP to an S3 bucket

質問済み 9ヶ月前2408ビュー
3回答
1

Hello, thank you for your question. Could you share more details about your use case so we can better assist you? You can use an AWS Transfer Family FTP-enabled server upload and download data to and from S3. More details about creating an FTP-enabled server can be found here.

AWS
エキスパート
回答済み 9ヶ月前
profile picture
エキスパート
レビュー済み 9ヶ月前
0

I would like to download ~1TB to an S3 bucket from a public data depository. One option is through FTP although there is an option to use Globus

回答済み 9ヶ月前
0

You can put SFTP or FTPS in front of the bucket using AWS Transfer Family. Note that if the source is initiating a connection over the internet to a public endpoint (which appears to be the case here) then plain FTP cannot be used, only SFTP or FTPS https://repost.aws/knowledge-center/aws-sftp-endpoint-type

Uploading 1TB will take a long time (at a sustained 100Mbps it will take about a day).

Away from (S)FTP if you are aiming to upload a relatively small number of very large files, S3 multipart upload may be more suitable https://docs.aws.amazon.com/AmazonS3/latest/userguide/mpuoverview.html

There is a useful knowledge document about using multipart upload here https://repost.aws/knowledge-center/s3-multipart-upload-cli

profile picture
エキスパート
Steve_M
回答済み 9ヶ月前
profile picture
エキスパート
レビュー済み 9ヶ月前

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン

関連するコンテンツ