What service should I use to run a python script stored in a bucket in AWS S3

0

I'm trying to run a python script and its accompanying data that I've stored in an AWS S3 bucket. But it seems like I have to connect the bucket to another AWS service in order to run the objects within it.

I tried exploring AWS CLI and AWS Systems Manager Console but they seem only to exist to manage S3 buckets rather than run objects/files in them. Please help!

franzad
preguntada hace un año823 visualizaciones
3 Respuestas
2

if you are going to run file stored in S3 bucket, you need either download it in advance and execute it or you can mount S3 as a file system using tool like https://github.com/s3fs-fuse/s3fs-fuse

profile picture
EXPERTO
respondido hace un año
profile picture
EXPERTO
Artem
revisado hace 2 meses
1

S3 is primarily for storage. You can define your script as AWS Lambda Function to perform necessary actions on objects in S3. (assuming a single iteration of your script does not run for 15 min ). Another option for long running jobs would be to run the script in an EC2 instance, or evaluate the usefulness of Step Functions / AWS Batch

profile picture
Syd
respondido hace un año
0

Hi, could you review the following link where the documentation guides you in detail (Running scripts from Amazon S3): https://docs.aws.amazon.com/systems-manager/latest/userguide/integration-s3.html

The article details the forms of execution, you can choose between: a) Run a shell script from Amazon S3 (console): or b) Run a shell script from Amazon S3 (command line)

I hope it helps you.

profile picture
respondido hace un año

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas