Questions tagged with Amazon EMR
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Have not been able to create a simple EMR cluster all day! Keep getting:
* 2023-04-11 20:35:59,668 INFO i-0ef1cde5b1311d42c: new instance started
* **2023-04-11 20:35:59,684 ERROR...
Accepted AnswerAmazon EMR
2
answers
0
votes
327
views
asked a year agolg...
Hello,
I am facing a very frustrating problem, Jupyter Hub is showing up the main page and after logging in with default jovyan/jupyter credentials I cannot start a notebook server.
I setup an EMR...
1
answers
0
votes
445
views
asked a year agolg...
we have deployed Apache Spark into a kubernetes cluster by our own.
In the past, in EMR, setting "hive.metastore.client.factory.class" was enough to use glue catalog. Unfortunattely, In our own...
1
answers
0
votes
2161
views
asked a year agolg...
What are the key differences between Amazon EFS and Amazon EBS storage options? In what scenarios would you recommend using each?
1
answers
0
votes
1297
views
asked a year agolg...
Hello.
Could you advice what instruments is more suitable for migrate a Spark app to AWS? :
The Spark applicaiton is for change data only, without any UI. We started it time-to-time, may be several...
1
answers
0
votes
284
views
asked a year agolg...
* below CF stack is failing with this error "Resource handler returned message: Error occurred during operation 'CreateApplication'." (RequestToken: <some-token-id>, HandlerErrorCode:...
1
answers
0
votes
477
views
asked a year agolg...
Hi there,
I need to create a custom kernel with my own libraries for use in EMR, so Im trying to follow this EMR...
0
answers
0
votes
94
views
asked a year agolg...
Hi,
I have been trying to connect EMR notebook to Git for last 2days. I am following steps in below link
https://aws.amazon.com/premiumsupport/knowledge-center/link-emr-notebook-git-repository/
I...
1
answers
0
votes
231
views
asked a year agolg...
Hope everyone is doing well!
Here's the context of the issue I'm facing, I'm working on a company that is supporting a really old airflow version, here are the details of the version and some...
1
answers
0
votes
75
views
asked a year agolg...
I want to create an EMR Cluster. To do that, I need to select a service role in the last step, but when I click the drop box, no role appears. When I looked at someone's tutorial, there was a default...
1
answers
0
votes
293
views
asked a year agolg...
I am trying to use EMR notebook in combined with a custom jar stored in S3.
I can easily include the jar in spark-shell by running:
```
spark-shell --jars <S3 jar path>
```
I want to achieve the...
1
answers
0
votes
477
views
asked a year agolg...
Hi,
I built Iceberg table that uses Glue as the Hive catalog. Team members I work with want to connect to it using Spark. They run Spark locally on their laptop and want to read the table or they have...
1
answers
1
votes
384
views
asked a year agolg...