Questions tagged with Amazon EMR
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
We are aware that AWS recommendation is to use 3 primary nodes, but for some reason in our lower environments we want to go with 1 primary node
We are planning to use only one primary node for our...
1
answers
0
votes
624
views
asked 9 months agolg...
Hello Team,
We are facing issues with EMR 6.10.0 SPARK(pyspark) Application and following are the details for it ,
1) Spark submit is failing in cluster mode for pyspark application
2) However we...
1
answers
1
votes
838
views
asked 9 months agolg...
Recurring Issue with AWS Athena When Running Queries on Iceberg Table.
Description
I am trying to run queries on an Iceberg table using AWS Athena. The data is stored in S3, and I am using EMR...
1
answers
0
votes
657
views
asked 9 months agolg...
Confirmed this by
- setting `s3.persistence.bucket` to the same value as in EMR 6.12, but my old notebooks did not appear,
- setting `s3.persistence.bucket` to a garbage value (i.e., non-existent...
1
answers
0
votes
276
views
asked 9 months agolg...
When I create an Iceberg table in AWS Athena in analogy to the example at the bottom of...
2
answers
0
votes
1451
views
asked 10 months agolg...
Did AWS charge any cost for Emr cluster during his creating&bootstrapping? Or cost charging only after cluster goes to "waiting" status?
1
answers
0
votes
422
views
asked 10 months agolg...
Why I got this issue when subnets and vpc are exist ??
Failed to create Workspace.
Invalid studio subnet configuration. All of the studio subnets are invalid/deleted. Please use a studio with valid...
1
answers
0
votes
285
views
asked 10 months agolg...
I am getting a validation error, when I try to create a managed endpoint for EMR on EKS.
```
{
"type": "JUPYTER_ENTERPRISE_GATEWAY",
"state": "TERMINATED_WITH_ERRORS",
"releaseLabel":...
1
answers
2
votes
463
views
asked 10 months agolg...
Hello everyone!
I'm seeking advice on architecture design using AWS, specifically regarding the feature store process. Currently, I'm in the prototyping phase and using the tsfresh library for...
1
answers
0
votes
230
views
asked 10 months agolg...
How to run a Hadoop Jar file (a mapreduce job) on EMR cluster in the CLI mode?
I have already set the cluster and have a jar file. However, I don't know how to use Hadoop to run the Jar file.
any...
1
answers
0
votes
586
views
asked 10 months agolg...
EMR Cluster Logslg...
How can I resolve ''S3 BUCKET NOT REACHABLE'' while trying to Publish Cluster-Specific logs to Amazon S3?
1
answers
0
votes
339
views
asked 10 months agolg...
Hi,
I am trying to read Excel file in Glue PySpark notebook.
I am using Crealytics Spark Excel package. I have added all the extra jars and packages through the magic commands, before creating the...
1
answers
0
votes
730
views
asked a year agolg...