Receiving consistent AccessDenied errors

0

I am trying to use SageMaker Notebook Instances, but consistently receive AccessDenied errors for commands that my IAM role should have access to (and for commands that worked the last time I tried several weeks ago). For example:

aws s3 ls results in An error occurred (AccessDenied) when calling the ListBuckets operation: Access Denied despite my role having the AmazonS3FullAccess policy attached.

Also aws ecr describe-repositories --repository-names "sagemaker-decision-trees" results in An error occurred (AccessDeniedException) when calling the DescribeRepositories operation: User: arn:aws:sts::XXXXXXXXXX:assumed-role/AmazonSageMaker-ExecutionRole-20201123T151452/SageMaker is not authorized to perform: ecr:DescribeRepositories on resource: arn:aws:ecr:us-east-2:XXXXXXXXXX:repository/sagemaker-decision-trees with an explicit deny despite my role having the AmazonEC2ContainerRegistryFullAccess policy attached.

One thing that seems new is that "SageMaker" is appended to my user ARN. I can't remember seeing errors with this appended before.

Note: I've replicated these errors with several combinations of configurations:

  • a new IAM role (which I created in the SageMaker console to have AmazonSageMakerFullAccess to any S3 bucket)
  • fresh notebook instance
  • with (and without) a VPC
    Also, these commands all work when run outside of a notebook instance (i.e. when run locally from my laptop).

I'm guessing there's some problem with my account setup, but not sure what to try next.
Thanks.

Edited by: DJAIndeed on Nov 24, 2020 8:35 AM

asked 3 years ago418 views
2 Answers
0

I am sorry to hear that you are not able to access required services from Sagemaker.
You can run below command to check the execution role that is getting used and then verify that required permission are present.

import sagemaker  
sagemaker.get_execution_role()  

Other useful links -
https://docs.aws.amazon.com/sagemaker/latest/dg/sagemaker-roles.html
https://aws.amazon.com/premiumsupport/knowledge-center/s3-troubleshoot-403/

Edited by: amitsur on Dec 22, 2020 2:41 PM

amitsur
answered 3 years ago
0

Thanks, @amitsur. We had confirmed that the SageMaker Notebook Instance was using the desired execution role and that that role had the required permissions. The issue appears to have resolved itself though, since we're no longer receiving these errors. So it must have been a configuration elsewhere? We appreciate the help anyway.

answered 3 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions