How to get file from remote sftp server to s3

Question

I am looking for a way to get file from SFTP server which is hosted outside AWS, the source will not make any changes at their end so i can't use datasync or s3 cli, what other option i have to get the data from remote SFTP server.

Max Clements EXPERT
il y a 2 mois
Do you need to do this one time, or is this a recurring process?

Answer

You can do this programmatically, for either one-off or repeated approach. I just published a selection on resources about uploading large files to s3: https://repost.aws/selections/KPZHjZ7hWnRs2APnSxxrHN3w/upload-large-files-to-s3

Answer

Use SFTP connector feature from AWS Transfer Family to pull files from a remote SFTP server.
Steps. Integrate this with eventbridge scheduler to make it recurring.

Steps:
1. Create a SFTP connector to the remote host
2. Create a lambda which calls the above connector, specify the source (remote server file location) and target (s3 path to store).

Reference:
https://docs.aws.amazon.com/transfer/latest/userguide/creating-connectors.html

How to get file from remote sftp server to s3

Contenus pertinents