Skip to content
By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post
About re:Post

How to Download any file from s3 using the pyspark kernel in emr notebook ?

0

i have made a cluster of emr having 2 nodes and some tools, and created one notebook to attached them to the cluster, while running the notebook having pyspark cluster, need to download files from s3, i am using the boto3 client and trying to access the file, but getting permission denied. i attached the image for reference, roles attached to the cluster as well as the notebook has s3fullaccess policy attached. How to download file from S3.

Topics
Analytics
Tags
Amazon EMR
Language
English

asked 6 years ago1.1K views

1 Answer
0

it is not an emr role issue or s3 issue, just try to save the file or data in the /tmp/ directory it will work.

answered 6 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Relevant content