How to get file from remote sftp server to s3

0

I am looking for a way to get file from SFTP server which is hosted outside AWS, the source will not make any changes at their end so i can't use datasync or s3 cli, what other option i have to get the data from remote SFTP server.

  • Do you need to do this one time, or is this a recurring process?

GB
preguntada hace 2 meses770 visualizaciones
2 Respuestas
2

You can do this programmatically, for either one-off or repeated approach. I just published a selection on resources about uploading large files to s3: https://repost.aws/selections/KPZHjZ7hWnRs2APnSxxrHN3w/upload-large-files-to-s3

profile picture
EXPERTO
respondido hace 2 meses
profile picture
EXPERTO
revisado hace 2 meses
profile picture
EXPERTO
revisado hace 2 meses
profile picture
EXPERTO
revisado hace 2 meses
0

Use SFTP connector feature from AWS Transfer Family to pull files from a remote SFTP server. Steps. Integrate this with eventbridge scheduler to make it recurring.

Steps:

  1. Create a SFTP connector to the remote host
  2. Create a lambda which calls the above connector, specify the source (remote server file location) and target (s3 path to store).

Reference: https://docs.aws.amazon.com/transfer/latest/userguide/creating-connectors.html

AWS
respondido hace un mes

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas