Hello,
I am trying to run my first job in AWS Glue, but I am encountering the following error: "An error occurred while calling o103.pyWriteDynamicFrame. /run-1679066163418-part-r-00000 (Permission denied)".
The error message indicates that the permission has been denied. I am using an IAM Role that has AmazonS3FullAccess, AWSGlueServiceRole, and even AdministratorAccess. Although I understand that this is not ideal for security reasons, I added this policy to ensure that the IAM Role is not the issue.
I have attempted to use different sources (such as DynamoDB and S3) and targets (such as Redshift and Datacatalog), but I consistently receive the same error. Does anyone know how I can resolve this issue?
Thank you in advance!
Could you please elaborate more on your use-case ? what is this glue ETL job trying to do ?
Is it possible you are trying to write into a bucket in a different account or with a policy that restricts you?
Also, please check if there's a bucket policy on s3 bucket that's blocking access for Glue job.