Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
AWS Glue Python Shell currently supports Python 3.9, whereas AWS Glue Pyspark jobs support Python 3.10 and AWS Lambda up to 3.12. When will we see support for more recent Python runtimes in the AWS...
0
answers
0
votes
95
views
asked 21 days agolg...
I am reading multiple files from S3 and writing the output to Redshift DB. Below is my code to read all the files from a S3 location (s3://abc/oms/YFS_CATEGORY_ITEM/)
```
yfs_category_item_df =...
2
answers
0
votes
489
views
asked 23 days agolg...
Bug Report: Glue task-oriented landing page annoying prompt, annoying redirection from breadcrumbslg...
new task oriented landing page causes annoying prompt every page load, and an even more annoying redirection every time I click on a breadcrumb link.
I visit the AWS Glue page, and see the new...
1
answers
0
votes
129
views
asked 23 days agolg...
I am trying to use geopandas in a python shell job, but can't get it working.
I have tried following this guide: https://repost.aws/knowledge-center/glue-import-error-no-module-named
and also...
1
answers
0
votes
138
views
asked 24 days agolg...
I know that Glue Data Quality works with tables. But i can't make Glue Data Quality work with views. Is views DQ supported?
1
answers
0
votes
116
views
asked 24 days agolg...
We have a glue job that is writing large number of items to dynamo.
**If a write to dynamo fails, how can we have access to these individual failed records in order to attempt to resolve and...
1
answers
0
votes
275
views
asked 24 days agolg...
Hello, so I have my script that runs an Athena query and sends an email,
When I was testing in my machine in the terminal, running 'python3 name-file.py'. The script works fine, the query is run and...
0
answers
0
votes
127
views
asked 24 days agolg...
If we enable "Job Metrics" for Glue, are these considered "Custom" metrics that are subject to the pricing here:
https://aws.amazon.com/cloudwatch/pricing/
1
answers
0
votes
211
views
asked 24 days agolg...
Hi I have created an external table on AWS Glue catalog db .
The table points to a lz4 compressed file on an s3.
the table definition looks like this
```
CREATE EXTERNAL TABLE `myapplogs`(
...
1
answers
0
votes
281
views
asked 24 days agolg...
Hello,
I have a Glue table based on parquet files in S3 that is partitioned by 3 columns:
- event_date_year
- event_date_month
- event_date_day
I want to select data for a list of given event...
1
answers
0
votes
139
views
asked a month agolg...
"In my AWS Glue job, I've configured an ETL process to extract data from the Data Catalog, apply a transformation to detect Personally Identifiable Information (PII), and then store the transformed...
1
answers
0
votes
145
views
asked a month agolg...
Hi Everyone
Glad to get here and write you. I'm just staring with AWS with experience from Azure. I'm learnin Amazon Flue from Udemy, and when I try to create a crawler to scan my S3 objects I got a...
2
answers
0
votes
69
views
asked a month agolg...