Questions tagged with Amazon EMR
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Would like to have information about Graviton instance support EMR studio schedule/plan/roadmap?
1
answers
0
votes
448
views
asked 6 months agolg...
I am drafting a yaml for simple EMR cluster. It will be loaded to stack and run.
But I am tried to launch my yml with servicerole without any attached policies and jobflowrole without any policies....
2
answers
0
votes
301
views
asked 6 months agolg...
After setting up a Hadoop cluster on AWS, I've noticed that when I attempt to stop the instances once I'm done with my work for the day and plan to resume the next day, the instances are automatically...
1
answers
0
votes
262
views
asked 6 months agolg...
I want to know if the option exist in EMR or automated way to kill the spark job that says initial job not accepted any resources. Some of my cluster is transient that run off batch hour without...
Accepted AnswerAmazon EMR
1
answers
1
votes
254
views
asked 6 months agolg...
Hi,
Lets say we have 1 TB file in s3 to process it using aws emr .
As per documentation it says we need to select hardware 3 times the size of input file . So for processing 1 TB file we need ec2...
2
answers
2
votes
1114
views
asked 6 months agolg...
I am running Flink jobs in the AWS EMR. I current as-is situation is,
1. The flink job logs are currently getting stored in HDFS and it grows over time.
2. Currently there is no log rolling...
1
answers
0
votes
226
views
asked 6 months agolg...
I am having difficulty working reading and writing complex types from spark to redshift. I am using the EMR-6.12 image. One point of confusion is that the docs...
1
answers
0
votes
408
views
asked 6 months agolg...
Hi all, I was wondering if someone has encountered the following and it this is a known problem (with hopefully a simple workaround).
We are using docker images from our private ECR repo in Spark...
1
answers
1
votes
381
views
asked 6 months agolg...
Suppose, while creating an EMR I have selected two instance types for primary and core fleet, one in us-east-1a and the second in us-east-1b.....Now, if the cluster got launched in us-east-1a and...
1
answers
1
votes
197
views
asked 6 months agolg...
Hi,
I am getting yarn does not exist error when Connecting redshift cluster from emr where both are in same vpc. Is there any connectivity missing or any step that I need to make sure ?
1
answers
1
votes
209
views
asked 6 months agolg...
Hello Everyone,
I am facing difficulties while trying to load data from an Amazon Redshift cluster into a Spark dataframe using the included redshift connector from **EMR release 6.13.0** .
My...
1
answers
0
votes
495
views
asked 6 months agolg...
We want to call an service(ECS based) API at scale around 250K tps using AWS , we are looking for suggestions and want to evaluate can we do the same in EMR or distributed map.
Please let me know if...
1
answers
0
votes
188
views
asked 6 months agolg...