Unanswered Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I am using Glue Crawler to crawl for parquet files, partitioned by type/yyyy/mm/dd which has been working just great. However, we have just run into a scenario where we need to rename a column. Is it...
0
answers
0
votes
127
views
asked 8 months agolg...
My Glue 4.0 jobs have suddenly stopped working with error message below. As it is related to boto3, I am unable to make any changes to library config. Pls advise.
NB: I noticed that urllib3 released...
0
answers
0
votes
169
views
asked 8 months agolg...
There are two types of use cases for the CustomSQL rule. In my case, I want to use a rule of the Custom SQL to retrieve row-level results type. For example: CustomSql "select Name from primary where...
0
answers
0
votes
60
views
asked 8 months agolg...
I was trying to perform Glue ETL transformation and store it in AWS Serverless Redshift database and S3 (both) . However, even the Console generated PySpark sheet fails. Almost none of the methods...
0
answers
0
votes
166
views
asked 8 months agolg...
I am trying to connect AWS Glue Catalog to Redshift, but, I keep getting this error
`An error occurred while calling o86.getSink. The connection attempt failed`
In the logs (a part of it)
File...
0
answers
0
votes
184
views
asked 8 months agolg...
Currently the compression type only has "Uncompressed" and "Snappy".
Could we support "zstd" inside too?
Also, it would be great to list all supported other compression types. Thanks! 😃
![Enter...
0
answers
0
votes
54
views
asked 9 months agolg...
Hi Team,
AWS has given the following link [https://aws.amazon.com/blogs/compute/orchestrating-aws-glue-crawlers-using-aws-step-functions/]() to Orchestrate Glue Crawlers using Map state. I used this...
0
answers
0
votes
122
views
asked 9 months agolg...
Hi,
When I attempted to view my AWS Glue jobs in the management console, I get the following error:
There was an issue processing your request.
Error: Error: Minified React error #306; visit...
0
answers
0
votes
61
views
asked 9 months agolg...
When we use AWS Glue Crawler to register one Delta table in S3 into AWS Glue Catelog.
However, we got error
> ERROR : Internal Service Exception
After reading...
0
answers
0
votes
145
views
asked 9 months agolg...
Is there some kind of way to tell AWS services like Step Functions, Glue, and Redshift to use UTC exclusively, and simply not display local time anywhere?
Time zone display in AWS is an indecipherable...
0
answers
0
votes
157
views
asked 9 months agolg...
Hello,
I'm writing a custom transform where I want to use mode within pyspark.sql.functions but I get the same issue irrespective of whether I use * or import the specific module. How can I resolve...
0
answers
0
votes
90
views
asked 9 months agolg...
Hello All,
I m doing one AWS workshop(Data Engineering Immersion Day), as part of workshop, I have to create sql application(legacy), but now AWS deprecated that feature to create new applications. ...
0
answers
0
votes
112
views
asked 9 months agolg...