Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
In our ETL process we are building out a pipeline where someones job is to take input files (ex. csv) and map the columns to existing column names. After the mapping is complete a glue workflow will...
0
answers
0
votes
171
views
asked 15 days agolg...
Hi!
I am trying to use DataZone to share an Iceberg table from the Glue Data Catalog with another AWS account.
I have created the table with Athena in the source account like this:
```sql
CREATE...
0
answers
0
votes
72
views
asked 15 days agolg...
I am trying to create glue crawler for reading data from my s3 bucket but i am getting access denied error each time. I have tried using IAM user and root user as well. I am stuck in this issue. Can...
1
answers
0
votes
224
views
asked 15 days agolg...
![Enter image description here](/media/postImages/original/IMBuRkn9W7QT6CvwJB2m8InA)
Hello AWS Community,
I'm encountering an issue while attempting to extract a specific value from a column in AWS...
0
answers
0
votes
31
views
asked 15 days agolg...
I was working on the Glue console creating a job in the Visual Editor and then running the job. The next day I saw that I had been billed for interactive session usage and looking at the list of...
1
answers
0
votes
46
views
asked 16 days agolg...
Why don't I see the column - ruleset_name, in the output of s3 file generated by a Glue Data Quality job ? I see the below columns in the JSON output of the Glue DQ job. Is there any way, I can get...
0
answers
0
votes
100
views
asked 19 days agolg...
AWS Glue Python Shell currently supports Python 3.9, whereas AWS Glue Pyspark jobs support Python 3.10 and AWS Lambda up to 3.12. When will we see support for more recent Python runtimes in the AWS...
0
answers
0
votes
94
views
asked 19 days agolg...
I am reading multiple files from S3 and writing the output to Redshift DB. Below is my code to read all the files from a S3 location (s3://abc/oms/YFS_CATEGORY_ITEM/)
```
yfs_category_item_df =...
2
answers
0
votes
482
views
asked 20 days agolg...
Bug Report: Glue task-oriented landing page annoying prompt, annoying redirection from breadcrumbslg...
new task oriented landing page causes annoying prompt every page load, and an even more annoying redirection every time I click on a breadcrumb link.
I visit the AWS Glue page, and see the new...
1
answers
0
votes
129
views
asked 21 days agolg...
I am trying to use geopandas in a python shell job, but can't get it working.
I have tried following this guide: https://repost.aws/knowledge-center/glue-import-error-no-module-named
and also...
1
answers
0
votes
138
views
asked 22 days agolg...
I know that Glue Data Quality works with tables. But i can't make Glue Data Quality work with views. Is views DQ supported?
1
answers
0
votes
116
views
asked 22 days agolg...
We have a glue job that is writing large number of items to dynamo.
**If a write to dynamo fails, how can we have access to these individual failed records in order to attempt to resolve and...
1
answers
0
votes
274
views
asked 22 days agolg...