Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I have a **Databricks** pipeline set up to create **Delta tables**, using **Glue Catalog as the Metastore**. I was able to query the Delta table via Athena successfully. However, starting from...
1
answers
0
votes
180
views
asked 4 months agolg...
Cloning a notebook ETL job does not clone the notebook code. That is probably the most important thing to clone.
0
answers
0
votes
77
views
asked 4 months agolg...
I'm using Pandas to create a DataFrame with a single column of dates, which I then save as a Parquet file to an S3 bucket. Here's the code snippet I'm using:
```python
import pandas as pd
df =...
1
answers
0
votes
484
views
asked 4 months agolg...
I have an S3 bucket with mixed files (CSV and JSON), written there by an external process that is outside of my control.
I need to create two Glue tables:
1. Contains all of the data from CSVs
2....
1
answers
0
votes
183
views
asked 4 months agolg...
I created table with Glue Crawler op top of JSON files lying on s3. I can successfully query this table with Athena. However while trying to read it with Glue PySpark I am got error:
`Error Category:...
0
answers
0
votes
85
views
asked 4 months agolg...
I have an AWS Glue job that transfers data from a PostgreSQL database to Amazon S3. The job functioned efficiently until the size of the data increased. Now, when attempting to save approximately 2-3...
2
answers
0
votes
588
views
asked 4 months agolg...
As a subscriber, I have a Glue Table type Subscribed Data Asset in my Project. Now, I want to download the file corresponding to this Asset. How I can do that?
![Enter image description...
1
answers
0
votes
178
views
asked 4 months agolg...
Getting below error while querying a Glue Table using Athena
com.amazonaws.services.s3.model.AmazonS3Exception: Access Denied (Service: Amazon S3; Status Code: 403; Error Code: AccessDenied; Request...
1
answers
0
votes
394
views
asked 4 months agolg...
If a connect using query Editor V2 with IAM role, i am able to query catalog. But if i am trying to connect with database user, i am not able to do it.
Also how to i connect with a python client.
2
answers
0
votes
374
views
asked 4 months agolg...
Microsoft Visual Studio Code recently released v1.86 which increments the [required minimum version of a linux docker image to be based on at least glibc...
1
answers
1
votes
203
views
asked 4 months agolg...
Hello everyone,
we are facing a major issue regarding AWS Glue's workflows. For some reason starting from today 01/02/2024, we have noticed that some `ANY` and `ALL` triggers will activate and...
0
answers
5
votes
159
views
asked 4 months agolg...
I have added and verified my email in SES. However, when I use this service in Glue script, no email notification receives. Refer to screenshot.
![Enter image description...
1
answers
0
votes
138
views
asked 4 months agolg...