Unanswered Questions tagged with Amazon EMR
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hope everyone is doing well!
Here's the context of the issue I'm facing, I'm working on a company that is supporting a really old airflow version, here are the details of the version and some...
0
answers
0
votes
61
views
asked a year agolg...
[https://docs.aws.amazon.com/emr/latest/EMR-Serverless-UserGuide/using-ddb-connector.html#using-ddb-connector-query](This doc page) describes connecting to dynamodb from spark, however it is...
0
answers
0
votes
90
views
asked a year agolg...
Hello,
From the new interface how do we attach a cluster to an existing Workspace? In the old UI we could do this by clicking on the workspace but now clicking on it tries to start it. Thanks in...
0
answers
2
votes
85
views
asked a year agolg...
Hi All,
I am creating an EMR cluster programmatically and calling the start_notebook_execution and attaching that cluster to the notebook. This works fine when I do manually. But programmatically the...
0
answers
0
votes
74
views
asked a year agolg...
Folks:
I am running some code that uses a mix of PySpark (for data manipulation) and Python (for visualization). Very similar to this blog:...
0
answers
0
votes
185
views
asked a year agolg...
HIVE_UNSUPPORTED_FORMAT: Output format org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat with SerDe org.openx.data.jsonserde.JsonSerDe is not supported. If a data manifest file was generated...
0
answers
0
votes
177
views
asked a year agolg...
When selecting a pyspark kernel for a notebook in EMR studio, tab completion and tooltips (with shift-Tab) are not working as expected. This is especially true for for attribute listing after a dot...
0
answers
0
votes
76
views
asked 2 years agolg...
The following script does not create the table in the S3 location indicated by the query.
I tested it locally and the Delta Json file is created and contains the information about the created...
0
answers
0
votes
144
views
asked 2 years agolg...
What is the AWS recommended way for using Kinesis as a Source with Apache Spark Structured Streaming if running Spark jobs on EMR (not AWS Glue).
There is a [third party open source connector...
0
answers
0
votes
122
views
asked 2 years agolg...
I'm trying to setup a jupyterhub environment in AWS EMR. I've been following the instructions on the [documentation](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-jupyterhub.html) without...
0
answers
0
votes
124
views
asked 2 years agolg...
Hi, i am trying EMR on eks to run our ETL work load. One of the work load is failed because of the hdfs.
I am using 6.2.0 Spark EMR container. When i am trying to access hdfs on this image seeing...
0
answers
0
votes
96
views
asked 2 years agolg...
We are trying to use EMR Studio as a development environment for a medium complexity project which has the code split out into multiple files for testing and maintainability. There's simply too much...
0
answers
0
votes
102
views
asked 2 years agolg...