Skip to content

Service: EmrServerlessResourceManager; Status Code: 403; Error Code: AccessDeniedException

0

Hello,

Can we get solution for this error Service: EmrServerlessResourceManager; Status Code: 403; Error Code: AccessDeniedException while running spark submit jobs at EMR Serverless.

Below is the logs:

24/06/28 12:56:57 WARN DefaultEmrServerlessRMClient: Encountered exception when requesting SPARK_EXECUTOR containers. Future container launch rate will be slowed down until recovered. Next call will be allowed after 2000ms.
com.amazonaws.services.emrserverlessresourcemanager.model.EmrServerlessResourceManagerException: null (Service: EmrServerlessResourceManager; Status Code: 403; Error Code: AccessDeniedException; Request ID: 82c52193-3576-49f8-8805-35c6f5b37bb2; Proxy: null)
	at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1879) ~[emr-serverless-spark-goodies-2.3.0.jar:2.3.0]
24/07/01 10:28:16 WARN TaskSchedulerImpl: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources
24/07/01 10:28:23 ERROR EmrServerlessClusterSchedulerBackend: Abandoning job due to no executor being launched within 1200000ms after driver starts.
1 Answer
0

The error Service: EmrServerlessResourceManager; Status Code: 403; Error Code: AccessDeniedException you’re encountering typically indicates a permissions issue. You should check the IAM role associated with your EMR Serverless job for necessary permissions, verify the access permissions of the resources your job needs, ensure the network configuration allows traffic between the job and the resources, and check the request rate to avoid hitting a service limit.

EXPERT
answered 2 years ago
  • Able to run sample code and getting issues when we run with source code

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.