Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I am doing a AWS Glue job to read from Redshift (schema_1) and write it back to Redhshift (schema_2). This process is done using below:
```
Redshift_read =...
1
answers
0
votes
496
views
asked 4 months agolg...
Hi,
I have recently started working with AWS Glue. I have created a Visual ETL job and it ran successfully. I noticed it had somehow created an extra S3 bucket instead of using the desired bucket I...
1
answers
0
votes
186
views
asked 4 months agolg...
Hello Team,
I am trying to use a merge statement to merge data from the glue catalog to redshift tabes.
The requirement is to merge records and have a filter clause
For example: Here where the...
2
answers
0
votes
187
views
asked 4 months agolg...
Is there a way to access metadata of an S3 object using one of the analytics tool that amazon has? AWS Glue currently supports crawlers for the s3 data but I was not able to find any information on...
3
answers
0
votes
257
views
asked 4 months agolg...
Any tips to setup integration between AWS and Servicenow? For e.g to open a servicenow ticket automatically when a AWS Glue job fails
Accepted AnswerAWS Glue
1
answers
0
votes
183
views
asked 4 months agolg...
**When I'm trying to import a collection from MongoDB Atlas to AWS Glue using a MongoDB connection, I get the following error :**
Session failure.
InvalidInputException - Unable to resolve any valid...
1
answers
0
votes
218
views
asked 4 months agolg...
Hello,
I am getting below exception when two glue jobs consumes same stream. The Stream has multiple shards.
com.amazonaws.services.kinesis.model.ProvisionedThroughputExceededException: Rate exceeded...
1
answers
0
votes
1521
views
asked 4 months agolg...
How do I add a sort / dist key to the glue dynamicframe writer into redshift?
1
answers
0
votes
201
views
asked 4 months agolg...
Hi,
Currently I am loading data from bigquery using GlueContext into dynamic frame. There are around 60 million records that need to loaded in each batch which is taking a lot of time.
I need to...
2
answers
0
votes
160
views
asked 4 months agolg...
Hi everyone, I was recently using the 'glue.error.all' observability metric to send me a notification when my glue jobs fail through SNS topics. It was working fine, but recently I checked and saw...
1
answers
0
votes
288
views
asked 4 months agolg...
I am looking for a way to programmatically create a Glue data connection to OpenSearch. I cannot find find any info about this connection type being supported by the AWS API, SDK, CloudFormation etc...
2
answers
0
votes
613
views
asked 4 months agolg...
Good day. I'm trying to catch aws glue events using EventBridge. For this i use samples from https://repost.aws/knowledge-center/glue-sns-notification-state .
EvetBridge template:
{
"detail-type":...
1
answers
0
votes
177
views
asked 4 months agolg...