Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I am reading multiple files from S3 and writing the output to Redshift DB. Below is my code to read all the files from a S3 location (s3://abc/oms/YFS_CATEGORY_ITEM/)
```
yfs_category_item_df =...
2
answers
0
votes
333
views
asked 6 days agolg...
Bug Report: Glue task-oriented landing page annoying prompt, annoying redirection from breadcrumbslg...
new task oriented landing page causes annoying prompt every page load, and an even more annoying redirection every time I click on a breadcrumb link.
I visit the AWS Glue page, and see the new...
1
answers
0
votes
119
views
asked 7 days agolg...
I am trying to use geopandas in a python shell job, but can't get it working.
I have tried following this guide: https://repost.aws/knowledge-center/glue-import-error-no-module-named
and also...
1
answers
0
votes
126
views
asked 7 days agolg...
I know that Glue Data Quality works with tables. But i can't make Glue Data Quality work with views. Is views DQ supported?
1
answers
0
votes
105
views
asked 7 days agolg...
We have a glue job that is writing large number of items to dynamo.
**If a write to dynamo fails, how can we have access to these individual failed records in order to attempt to resolve and...
1
answers
0
votes
129
views
asked 7 days agolg...
Hello, so I have my script that runs an Athena query and sends an email,
When I was testing in my machine in the terminal, running 'python3 name-file.py'. The script works fine, the query is run and...
0
answers
0
votes
112
views
asked 7 days agolg...
If we enable "Job Metrics" for Glue, are these considered "Custom" metrics that are subject to the pricing here:
https://aws.amazon.com/cloudwatch/pricing/
1
answers
0
votes
177
views
asked 8 days agolg...
Hi I have created an external table on AWS Glue catalog db .
The table points to a lz4 compressed file on an s3.
the table definition looks like this
```
CREATE EXTERNAL TABLE `myapplogs`(
...
1
answers
0
votes
144
views
asked 8 days agolg...
Hello,
I have a Glue table based on parquet files in S3 that is partitioned by 3 columns:
- event_date_year
- event_date_month
- event_date_day
I want to select data for a list of given event...
1
answers
0
votes
126
views
asked 10 days agolg...
"In my AWS Glue job, I've configured an ETL process to extract data from the Data Catalog, apply a transformation to detect Personally Identifiable Information (PII), and then store the transformed...
1
answers
0
votes
118
views
asked 11 days agolg...
Hi Everyone
Glad to get here and write you. I'm just staring with AWS with experience from Azure. I'm learnin Amazon Flue from Udemy, and when I try to create a crawler to scan my S3 objects I got a...
2
answers
0
votes
58
views
asked 11 days agolg...
Hello AWS Community,
I'm facing a challenging issue with our AWS data pipeline that affects data visualization in Amazon QuickSight. Initially, our setup involved directly importing CSV data from S3...
0
answers
0
votes
150
views
asked 11 days agolg...