Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
We have a glue job that is writing large number of items to dynamo.
**If a write to dynamo fails, how can we have access to these individual failed records in order to attempt to resolve and...
1
answers
0
votes
303
views
asked 2 months agolg...
Hello, so I have my script that runs an Athena query and sends an email,
When I was testing in my machine in the terminal, running 'python3 name-file.py'. The script works fine, the query is run and...
0
answers
0
votes
140
views
asked 2 months agolg...
If we enable "Job Metrics" for Glue, are these considered "Custom" metrics that are subject to the pricing here:
https://aws.amazon.com/cloudwatch/pricing/
1
answers
0
votes
231
views
asked 2 months agolg...
Hi I have created an external table on AWS Glue catalog db .
The table points to a lz4 compressed file on an s3.
the table definition looks like this
```
CREATE EXTERNAL TABLE `myapplogs`(
...
1
answers
0
votes
302
views
asked 2 months agolg...
Hello,
I have a Glue table based on parquet files in S3 that is partitioned by 3 columns:
- event_date_year
- event_date_month
- event_date_day
I want to select data for a list of given event...
1
answers
0
votes
162
views
asked 2 months agolg...
"In my AWS Glue job, I've configured an ETL process to extract data from the Data Catalog, apply a transformation to detect Personally Identifiable Information (PII), and then store the transformed...
1
answers
0
votes
190
views
asked 2 months agolg...
Hi Everyone
Glad to get here and write you. I'm just staring with AWS with experience from Azure. I'm learnin Amazon Flue from Udemy, and when I try to create a crawler to scan my S3 objects I got a...
Accepted AnswerAWS Glue
3
answers
0
votes
88
views
asked 2 months agolg...
Hello AWS Community,
I'm facing a challenging issue with our AWS data pipeline that affects data visualization in Amazon QuickSight. Initially, our setup involved directly importing CSV data from S3...
0
answers
0
votes
203
views
asked 2 months agolg...
I'm running an EMR Serverless Spark job that uses Delta OSS to handle Delta tables. I previously resolved a configuration issue with EMR Serverless and AWS Glue Data Catalog...
1
answers
0
votes
295
views
asked 2 months agolg...
Why doesn't Glue Job and Glue Workflow have the function of version control and alias likes Labmda.lg...
I tried to develop the data orchestlation with s3, Glue Job and Glue Workflow. After I developed it, I found that Glue Job and Glue Workflow doesn't have the function of version control and alias...
0
answers
0
votes
190
views
asked 2 months agolg...
Hi team, first post, let me know if it provides a good explanation.
I'd like to know a way to minimize the effort for data ingestion.
We have two options as follows:
(1) csv files from a file...
0
answers
0
votes
312
views
asked 2 months agolg...
I get the error "InvalidInputException: Unable to resolve any valid connection" when I test my AWS Glue connection to my mongDB Atlas database.
I can connect with an identical string, user and...
1
answers
0
votes
84
views
asked 2 months agolg...