Questions tagged with AWS Glue
Content language: English
Sort by most recent
Using Glue Crawler created Catalog Table for a DynamoDB data source, and that was successful. I could see the column names correctly in the schema section of Catalog Table.
With Athena trying to run a...
Reference on Attached Picture.
We try to set up Glue connect MongoDB with Glue Connector
We get Error Message but...
I am trying to enable "Add new columns only" by selecting check box and json output for reference.
However, saving the crawler, it is automatically going back to
"Ignore the change and don't update...
Using the step: "Derived Column" where I can use SQL functions to derive new columns I found SUBSTRING works but CHARINDEX it doesn't. And as usual with AWS documentation, there's no place or...
Can anyone share any script that can be used in my glue job to load files from s3 to dynamo db?
Hi, we are testing with using AWS Glue DQ to run some checks on the tables. We have configured the check to run against a data catalog table.
When running a check on the date column, we are getting...
I created a table in the Glue Catalog via a Glue job. The job is very simple: it reads data from a crawled MySQL table and writes it to GZIP parquet files. When I try to use the new table in another...
Hi there,
I have an AWS Glue Pipeline where I am reading data from an RDS Postgres instance and copying data over into a RedShift warehouse. I have noticed that when using the "MERGE" operation, that...
asked 2 days ago
I am new to AWS Glue and I am encountering an issue while trying to use the "google bigquery connector 0.24.2 for aws glue 3.0" in an AWS Glue Job. The goal is to establish a connection between my RDS...
py4j.protocol.Py4JJavaError: An error occurred while calling o492.pyWriteDynamicFrame.
: org.apache.spark.SparkException: Job aborted due to stage failure: Task 323 in stage 2.0 failed 4 times, most...
Hi All,
I was following the steps mentioned at below link to work locally on my system .
https://aws.amazon.com/blogs/big-data/introducing-aws-glue-interactive-sessions-for-jupyter/
This is...
I have an IoT Device which is connected to IoT Core, through message routing in rule settings I send JSON nested data to Amazon Kinesis Data Stream. I then create an AWS Glue action that will be...