Specify credentials for GlueContext in s3 connection

0

I want to be able to dynamically pass credentials to glue when it creates the dynamic frame with glueContext.create_dynamic_frame.from_options with connection type "s3", the problem I don't know where I need to pass the credentials, of if I can even pass them.

I can't setup the s3 permissions directly to the Glue role, that's why I'm trying to find a way to pass the credentials to the script.

  • Could you explain why you are unable to provide S3 s3:GetObject", "s3:PutObject", "s3:DeleteObject" permission to the S3 bucket you are planning to read or write from Glue? Typical guidance is to create IAM policy for Glue service and attach to Glue Service Role

  • I pass the source and target dynamically via job attributes. As the job is used by different tenants, for security, each tenant can access only to their source and targets, that's why I can't give the permission directly to the glue role, otherwise a tenant could read/write to a different tenant, whilst passing the credentials, the job would be able to access only to the tenant locations

Miki
asked 2 years ago88 views
No Answers

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions