Questions tagged with Amazon EMR

Getting this error when trying to run a simple spark job which reads a json file from s3 and prints the...

I am using EMR 6.13.0, it is using python 3.7. in my code i have used boto3, the boto3 support for python 3.7 will be discontinued from December-2023. and as we aware the python 3.7 support stopped...

We currently have an EMR cluster with the next configuration. - Master instanceFleet ( 1 node r5a.xlarge on demand ) - Core instanceFleet ( 32 on demand units from multiple instance types ) - Task...

We are aware that AWS recommendation is to use 3 primary nodes, but for some reason in our lower environments we want to go with 1 primary node We are planning to use only one primary node for our...

Hello Team, We are facing issues with EMR 6.10.0 SPARK(pyspark) Application and following are the details for it , 1) Spark submit is failing in cluster mode for pyspark application 2) However we...

Recurring Issue with AWS Athena When Running Queries on Iceberg Table. Description I am trying to run queries on an Iceberg table using AWS Athena. The data is stored in S3, and I am using EMR...

Confirmed this by - setting `s3.persistence.bucket` to the same value as in EMR 6.12, but my old notebooks did not appear, - setting `s3.persistence.bucket` to a garbage value (i.e., non-existent...

When I create an Iceberg table in AWS Athena in analogy to the example at the bottom of...

Did AWS charge any cost for Emr cluster during his creating&bootstrapping? Or cost charging only after cluster goes to "waiting" status?

Why I got this issue when subnets and vpc are exist ?? Failed to create Workspace. Invalid studio subnet configuration. All of the studio subnets are invalid/deleted. Please use a studio with valid...

I am getting a validation error, when I try to create a managed endpoint for EMR on EKS. ``` { "type": "JUPYTER_ENTERPRISE_GATEWAY", "state": "TERMINATED_WITH_ERRORS", "releaseLabel":...

Hello everyone! I'm seeking advice on architecture design using AWS, specifically regarding the feature store process. Currently, I'm in the prototyping phase and using the tsfresh library for...