How to Download any file from s3 using the pyspark kernel in emr notebook ?

0

i have made a cluster of emr having 2 nodes and some tools, and created one notebook to attached them to the cluster, while running the notebook having pyspark cluster, need to download files from s3, i am using the boto3 client and trying to access the file, but getting permission denied. i attached the image for reference, roles attached to the cluster as well as the notebook has s3fullaccess policy attached. How to download file from S3.

asked 4 years ago606 views
1 Answer
0

it is not an emr role issue or s3 issue, just try to save the file or data in the /tmp/ directory it will work.

answered 4 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions