I want to be able to dynamically pass credentials to glue when it creates the dynamic frame with glueContext.create_dynamic_frame.from_options with connection type "s3", the problem I don't know where I need to pass the credentials, of if I can even pass them.
I can't setup the s3 permissions directly to the Glue role, that's why I'm trying to find a way to pass the credentials to the script.
AWS OFICIALAtualizada há 2 anos
Could you explain why you are unable to provide S3 s3:GetObject", "s3:PutObject", "s3:DeleteObject" permission to the S3 bucket you are planning to read or write from Glue? Typical guidance is to create IAM policy for Glue service and attach to Glue Service Role
I pass the source and target dynamically via job attributes. As the job is used by different tenants, for security, each tenant can access only to their source and targets, that's why I can't give the permission directly to the glue role, otherwise a tenant could read/write to a different tenant, whilst passing the credentials, the job would be able to access only to the tenant locations