Glue Job Error An error occurred while calling o98.parquet. Access Denied

Question

Hi Team,
I am trying to archive the mongodb data to S3 as parquet format using AWS Glue job, so that i have created spark script. When i am run the script i am getting below error.

**An error occurred while calling o98.parquet. Access Denied (Service: Amazon S3; Status Code: 403; Error Code: AccessDenied; Request ID: ; S3 Extended Request ID: ==; Proxy: null)**

How to resolve this issue, can someone help me to overcome this issue.

Thanks.

Answer

I've seen this issue quite a few times myself. Here is how I'd troubleshoot this issue:

First check if glue job service role has write access to S3 bucket and if S3 bucket is SSE-KMS CMK encrypted, then you need to grant your glue job service that KMS key access too. Additionally make sure there are no explicit deny in KMS key policy and bucket policyl, otherwise you'll need to update KMS Key policy and bucket policy allowing glue job service role access to it.

If you have cloudtrail enabled for data events, query the cloudtrail data through Athena for that request id.
Most likely you'll see that your glue job is trying to put/get/delete something from a random temp bucket. And if that would not be the case, then you'll se which bucket, what action is being denied.
On that basis, add those permissions to your glue job service role and run the job again.

Additionally refer [Encrypting data written by AWS Glue](https://docs.aws.amazon.com/glue/latest/dg/encryption-security-configuration.html).

Hope you find this helpful.

Comment here if you have additional questions, happy to help.

Abhishek

Glue Job Error An error occurred while calling o98.parquet. Access Denied

Relevant content