Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
In our ETL process we are building out a pipeline where someones job is to take input files (ex. csv) and map the columns to existing column names. After the mapping is complete a glue workflow will...
0
answers
0
votes
181
views
asked a month agolg...
Hi!
I am trying to use DataZone to share an Iceberg table from the Glue Data Catalog with another AWS account.
I have created the table with Athena in the source account like this:
```sql
CREATE...
0
answers
0
votes
104
views
asked a month agolg...
I am trying to create glue crawler for reading data from my s3 bucket but i am getting access denied error each time. I have tried using IAM user and root user as well. I am stuck in this issue. Can...
1
answers
0
votes
263
views
asked a month agolg...
![Enter image description here](/media/postImages/original/IMBuRkn9W7QT6CvwJB2m8InA)
Hello AWS Community,
I'm encountering an issue while attempting to extract a specific value from a column in AWS...
0
answers
0
votes
68
views
asked a month agolg...
I was working on the Glue console creating a job in the Visual Editor and then running the job. The next day I saw that I had been billed for interactive session usage and looking at the list of...
1
answers
0
votes
64
views
asked a month agolg...
Why don't I see the column - ruleset_name, in the output of s3 file generated by a Glue Data Quality job ? I see the below columns in the JSON output of the Glue DQ job. Is there any way, I can get...
0
answers
0
votes
110
views
asked a month agolg...
AWS Glue Python Shell currently supports Python 3.9, whereas AWS Glue Pyspark jobs support Python 3.10 and AWS Lambda up to 3.12. When will we see support for more recent Python runtimes in the AWS...
0
answers
0
votes
104
views
asked a month agolg...
I am reading multiple files from S3 and writing the output to Redshift DB. Below is my code to read all the files from a S3 location (s3://abc/oms/YFS_CATEGORY_ITEM/)
```
yfs_category_item_df =...
2
answers
0
votes
528
views
asked a month agolg...
Bug Report: Glue task-oriented landing page annoying prompt, annoying redirection from breadcrumbslg...
new task oriented landing page causes annoying prompt every page load, and an even more annoying redirection every time I click on a breadcrumb link.
I visit the AWS Glue page, and see the new...
1
answers
0
votes
144
views
asked a month agolg...
I am trying to use geopandas in a python shell job, but can't get it working.
I have tried following this guide: https://repost.aws/knowledge-center/glue-import-error-no-module-named
and also...
1
answers
0
votes
166
views
asked 2 months agolg...
I know that Glue Data Quality works with tables. But i can't make Glue Data Quality work with views. Is views DQ supported?
1
answers
0
votes
133
views
asked 2 months agolg...
We have a glue job that is writing large number of items to dynamo.
**If a write to dynamo fails, how can we have access to these individual failed records in order to attempt to resolve and...
1
answers
0
votes
302
views
asked 2 months agolg...