Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I get the error "InvalidInputException: Unable to resolve any valid connection" when I test my AWS Glue connection to my mongDB Atlas database.
I can connect with an identical string, user and...
1
answers
0
votes
84
views
asked 2 months agolg...
Kinesis Firehose allows to configure S3 as a destination and in the Parquet section allows selecting a Glue catalog table of format Iceberg. However I had little to no luck querying the data.
Does...
1
answers
0
votes
156
views
asked 2 months agolg...
I am trying to connect AWS glue crawler with a postgres db on RDS. Both the crawler and DB are in the same region. steps followed:
1. created a connection with jdbc url username and...
1
answers
0
votes
147
views
asked 2 months agolg...
Hi all,
I have shared a Glue table (S3) with another account where I can already query it via Athena.
Now I added LakeFormation permissions for the database and table to the role that I am using...
1
answers
0
votes
140
views
asked 2 months agolg...
I want to use AWS Glue Data Catalog as a metastore. I'm running an EMR Serverless job that inserts and updates data in a Delta Table. I've successfully populated Delta tables on my localhost...
2
answers
0
votes
149
views
asked 2 months agolg...
Hi, I'm implementing a case where either one column can be null, but not both in the same record. And implementing rule
(ColumnValues "col_1" = NULL) or (ColumnValues "col_2" = NULL)
I'm seeing below...
1
answers
0
votes
70
views
asked 2 months agolg...
Glue Job - S3 to S3lg...
Hi Team,
I am working on Glue to job to copy/move file from one bucket to another bucket. Could you please help me with your thoughts
1. Using Python how to copy/move the unzipped file to target...
0
answers
0
votes
87
views
asked 2 months agolg...
Following this post: https://repost.aws/knowledge-center/glue-reduce-cloudwatch-logs
I have created the following glue job:
```
from awsglue.context import GlueContext
from pyspark.context import...
1
answers
0
votes
219
views
asked 2 months agolg...
Hi,
I am testing Amazon DataZone features and therefore set up a domain together with another associated account.
I enabled the DataLake blueprint in both accounts. I have 2 projects (producer,...
2
answers
0
votes
137
views
asked 2 months agolg...
Hi,
I am runing a Spark ETL glue job and want to see how the executor's log through Spark UI. However, I didn't see the executor logs like stderr and stdout. Can you please advise how to find the...
2
answers
0
votes
141
views
asked 2 months agolg...
I can't use my personal root account to create Glue job or Glue Crawler
got such as
Failed to update job
[gluestudio-service.ap-southeast-1.amazonaws.com] createJob: AccessDeniedException: Account...
2
answers
0
votes
154
views
asked 2 months agolg...
My company is pushing to have everything "As Code" and I was wondering which tool is better for us.
Since we are not allowed to use the Glue interface to create ETLs, to configure the settings, and...
1
answers
0
votes
133
views
asked 2 months agolg...