Questions tagged with Amazon EMR
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
We are aware that AWS recommendation is to use 3 primary nodes, but for some reason in our lower environments we want to go with 1 primary node
We are planning to use only one primary node for our...
1
answers
0
votes
633
views
asked 9 months agolg...
Hello Team,
We are facing issues with EMR 6.10.0 SPARK(pyspark) Application and following are the details for it ,
1) Spark submit is failing in cluster mode for pyspark application
2) However we...
1
answers
1
votes
859
views
asked 9 months agolg...
Recurring Issue with AWS Athena When Running Queries on Iceberg Table.
Description
I am trying to run queries on an Iceberg table using AWS Athena. The data is stored in S3, and I am using EMR...
1
answers
0
votes
667
views
asked 9 months agolg...
Confirmed this by
- setting `s3.persistence.bucket` to the same value as in EMR 6.12, but my old notebooks did not appear,
- setting `s3.persistence.bucket` to a garbage value (i.e., non-existent...
1
answers
0
votes
279
views
asked 10 months agolg...
When I create an Iceberg table in AWS Athena in analogy to the example at the bottom of...
2
answers
0
votes
1469
views
asked 10 months agolg...
Did AWS charge any cost for Emr cluster during his creating&bootstrapping? Or cost charging only after cluster goes to "waiting" status?
1
answers
0
votes
426
views
asked 10 months agolg...
Why I got this issue when subnets and vpc are exist ??
Failed to create Workspace.
Invalid studio subnet configuration. All of the studio subnets are invalid/deleted. Please use a studio with valid...
1
answers
0
votes
289
views
asked 10 months agolg...
I am getting a validation error, when I try to create a managed endpoint for EMR on EKS.
```
{
"type": "JUPYTER_ENTERPRISE_GATEWAY",
"state": "TERMINATED_WITH_ERRORS",
"releaseLabel":...
1
answers
2
votes
465
views
asked 10 months agolg...
Hello everyone!
I'm seeking advice on architecture design using AWS, specifically regarding the feature store process. Currently, I'm in the prototyping phase and using the tsfresh library for...
1
answers
0
votes
232
views
asked 10 months agolg...
How to run a Hadoop Jar file (a mapreduce job) on EMR cluster in the CLI mode?
I have already set the cluster and have a jar file. However, I don't know how to use Hadoop to run the Jar file.
any...
1
answers
0
votes
593
views
asked 10 months agolg...
EMR Cluster Logslg...
How can I resolve ''S3 BUCKET NOT REACHABLE'' while trying to Publish Cluster-Specific logs to Amazon S3?
1
answers
0
votes
344
views
asked 10 months agolg...
Hi,
I am trying to read Excel file in Glue PySpark notebook.
I am using Crealytics Spark Excel package. I have added all the extra jars and packages through the magic commands, before creating the...
1
answers
0
votes
739
views
asked a year agolg...