Unanswered Questions tagged with Amazon EMR
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hi there,
I need to create a custom kernel with my own libraries for use in EMR, so Im trying to follow this EMR...
0
answers
0
votes
79
views
asked a year agolg...
Hope everyone is doing well!
Here's the context of the issue I'm facing, I'm working on a company that is supporting a really old airflow version, here are the details of the version and some...
0
answers
0
votes
61
views
asked a year agolg...
[https://docs.aws.amazon.com/emr/latest/EMR-Serverless-UserGuide/using-ddb-connector.html#using-ddb-connector-query](This doc page) describes connecting to dynamodb from spark, however it is...
0
answers
0
votes
90
views
asked a year agolg...
Hello,
From the new interface how do we attach a cluster to an existing Workspace? In the old UI we could do this by clicking on the workspace but now clicking on it tries to start it. Thanks in...
0
answers
2
votes
85
views
asked a year agolg...
Hi All,
I am creating an EMR cluster programmatically and calling the start_notebook_execution and attaching that cluster to the notebook. This works fine when I do manually. But programmatically the...
0
answers
0
votes
74
views
asked a year agolg...
Folks:
I am running some code that uses a mix of PySpark (for data manipulation) and Python (for visualization). Very similar to this blog:...
0
answers
0
votes
188
views
asked a year agolg...
HIVE_UNSUPPORTED_FORMAT: Output format org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat with SerDe org.openx.data.jsonserde.JsonSerDe is not supported. If a data manifest file was generated...
0
answers
0
votes
178
views
asked a year agolg...
When selecting a pyspark kernel for a notebook in EMR studio, tab completion and tooltips (with shift-Tab) are not working as expected. This is especially true for for attribute listing after a dot...
0
answers
0
votes
77
views
asked 2 years agolg...
The following script does not create the table in the S3 location indicated by the query.
I tested it locally and the Delta Json file is created and contains the information about the created...
0
answers
0
votes
146
views
asked 2 years agolg...
What is the AWS recommended way for using Kinesis as a Source with Apache Spark Structured Streaming if running Spark jobs on EMR (not AWS Glue).
There is a [third party open source connector...
0
answers
0
votes
122
views
asked 2 years agolg...
I'm trying to setup a jupyterhub environment in AWS EMR. I've been following the instructions on the [documentation](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-jupyterhub.html) without...
0
answers
0
votes
124
views
asked 2 years agolg...
Hi, i am trying EMR on eks to run our ETL work load. One of the work load is failed because of the hdfs.
I am using 6.2.0 Spark EMR container. When i am trying to access hdfs on this image seeing...
0
answers
0
votes
97
views
asked 2 years agolg...