Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I'm using Pandas to create a DataFrame with a single column of dates, which I then save as a Parquet file to an S3 bucket. Here's the code snippet I'm using:
```python
import pandas as pd
df =...
1
answers
0
votes
392
views
asked 3 months agolg...
I have an S3 bucket with mixed files (CSV and JSON), written there by an external process that is outside of my control.
I need to create two Glue tables:
1. Contains all of the data from CSVs
2....
1
answers
0
votes
157
views
asked 3 months agolg...
I created table with Glue Crawler op top of JSON files lying on s3. I can successfully query this table with Athena. However while trying to read it with Glue PySpark I am got error:
`Error Category:...
0
answers
0
votes
76
views
asked 3 months agolg...
I have an AWS Glue job that transfers data from a PostgreSQL database to Amazon S3. The job functioned efficiently until the size of the data increased. Now, when attempting to save approximately 2-3...
2
answers
0
votes
464
views
asked 3 months agolg...
As a subscriber, I have a Glue Table type Subscribed Data Asset in my Project. Now, I want to download the file corresponding to this Asset. How I can do that?
![Enter image description...
1
answers
0
votes
156
views
asked 3 months agolg...
Getting below error while querying a Glue Table using Athena
com.amazonaws.services.s3.model.AmazonS3Exception: Access Denied (Service: Amazon S3; Status Code: 403; Error Code: AccessDenied; Request...
1
answers
0
votes
369
views
asked 3 months agolg...
If a connect using query Editor V2 with IAM role, i am able to query catalog. But if i am trying to connect with database user, i am not able to do it.
Also how to i connect with a python client.
2
answers
0
votes
321
views
asked 3 months agolg...
Microsoft Visual Studio Code recently released v1.86 which increments the [required minimum version of a linux docker image to be based on at least glibc...
1
answers
1
votes
181
views
asked 3 months agolg...
Hello everyone,
we are facing a major issue regarding AWS Glue's workflows. For some reason starting from today 01/02/2024, we have noticed that some `ANY` and `ALL` triggers will activate and...
0
answers
5
votes
145
views
asked 3 months agolg...
I have added and verified my email in SES. However, when I use this service in Glue script, no email notification receives. Refer to screenshot.
![Enter image description...
1
answers
0
votes
127
views
asked 3 months agolg...
Hi all,
I gave full access to S3 and Glue for the role.
Created a crawler to use data in S3 for Glue Catalog tables. The crawler runs successful and logs in CloudWatch also show table created and...
0
answers
0
votes
199
views
asked 3 months agolg...
Hi,
We send our database old data into S3 in this format:
{table}/year/month/day/asset_id.parquet
so we have a lot of files like...
1
answers
0
votes
363
views
asked 3 months agolg...