Direkt zum Inhalt

How to Download any file from s3 using the pyspark kernel in emr notebook ?

0

i have made a cluster of emr having 2 nodes and some tools, and created one notebook to attached them to the cluster, while running the notebook having pyspark cluster, need to download files from s3, i am using the boto3 client and trying to access the file, but getting permission denied. i attached the image for reference, roles attached to the cluster as well as the notebook has s3fullaccess policy attached. How to download file from S3.

gefragt vor 6 Jahren1100 Aufrufe

1 Antwort
0

it is not an emr role issue or s3 issue, just try to save the file or data in the /tmp/ directory it will work.

beantwortet vor 6 Jahren

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.