Unanswered Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Question:
We currently have approximately 100 tables in delta format, partitioned by yyyy, mm, dd, hh, mm. Our current process involves reading these delta tables via a crawler, cataloging them, and...
0
answers
0
votes
362
views
asked 2 months agolg...
AWS Glue DataBrewlg...
Hello All ,
I am trying to clean up my dataset see below ![Dataset](/media/postImages/original/IMlISUqk8QRVCZTKGDM3uwcA).
I want to remove the first row since the name is invalid and want to add it...
0
answers
0
votes
120
views
asked 2 months agolg...
Hi everyone,
I've been running a Glue job smoothly for the past year, processing a collection of individual data blocks from Location A and transferring them to Location B. Each block shares the same...
0
answers
0
votes
97
views
asked 3 months agolg...
I am working in the Glue ETL Visual Editor and I've started to encounter this error `QuotaExceededError - Failed to execute 'setItem' on 'Storage'`.
It is preventing me from even starting a Data...
0
answers
0
votes
124
views
asked 3 months agolg...
I received this error - ResourceSetupError: Exception when listing images from AWS Glue. There are no logs because the duration of the job was 0s.
Why? =/
0
answers
0
votes
353
views
asked 3 months agolg...
Cloning a notebook ETL job does not clone the notebook code. That is probably the most important thing to clone.
0
answers
0
votes
77
views
asked 4 months agolg...
I created table with Glue Crawler op top of JSON files lying on s3. I can successfully query this table with Athena. However while trying to read it with Glue PySpark I am got error:
`Error Category:...
0
answers
0
votes
82
views
asked 4 months agolg...
Hello everyone,
we are facing a major issue regarding AWS Glue's workflows. For some reason starting from today 01/02/2024, we have noticed that some `ANY` and `ALL` triggers will activate and...
0
answers
5
votes
154
views
asked 4 months agolg...
Hi all,
I gave full access to S3 and Glue for the role.
Created a crawler to use data in S3 for Glue Catalog tables. The crawler runs successful and logs in CloudWatch also show table created and...
0
answers
0
votes
205
views
asked 4 months agolg...
Hi all! I need some guidance on the proper way to connect to an Oracle Free Tier Autonomous Database from a Glue ETL Job. I’ve been using the following code snippet, but I encountered an error -...
0
answers
0
votes
620
views
asked 4 months agolg...
I have multiple Visual ETL configured correctly, but if go back to the previous screen and then try to see the job again, the display editor will lost the configuration and it will highlight some...
0
answers
0
votes
107
views
asked 4 months agolg...
Trying to figure out if it's possible to use AWS Glue crawler to parse the spark stderr logs that are dumped from emr-serverless.
The logs are space delimited. I tried running a crawler against the...
0
answers
0
votes
164
views
asked 4 months agolg...