Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
We have a glue job that is writing large number of items to dynamo.
**If a write to dynamo fails, how can we have access to these individual failed records in order to attempt to resolve and...
1
answers
0
votes
274
views
asked 22 days agolg...
Hello, so I have my script that runs an Athena query and sends an email,
When I was testing in my machine in the terminal, running 'python3 name-file.py'. The script works fine, the query is run and...
0
answers
0
votes
125
views
asked 22 days agolg...
If we enable "Job Metrics" for Glue, are these considered "Custom" metrics that are subject to the pricing here:
https://aws.amazon.com/cloudwatch/pricing/
1
answers
0
votes
208
views
asked 22 days agolg...
Hi I have created an external table on AWS Glue catalog db .
The table points to a lz4 compressed file on an s3.
the table definition looks like this
```
CREATE EXTERNAL TABLE `myapplogs`(
...
1
answers
0
votes
278
views
asked 22 days agolg...
Hello,
I have a Glue table based on parquet files in S3 that is partitioned by 3 columns:
- event_date_year
- event_date_month
- event_date_day
I want to select data for a list of given event...
1
answers
0
votes
138
views
asked 25 days agolg...
"In my AWS Glue job, I've configured an ETL process to extract data from the Data Catalog, apply a transformation to detect Personally Identifiable Information (PII), and then store the transformed...
1
answers
0
votes
139
views
asked 25 days agolg...
Hi Everyone
Glad to get here and write you. I'm just staring with AWS with experience from Azure. I'm learnin Amazon Flue from Udemy, and when I try to create a crawler to scan my S3 objects I got a...
2
answers
0
votes
68
views
asked 25 days agolg...
Hello AWS Community,
I'm facing a challenging issue with our AWS data pipeline that affects data visualization in Amazon QuickSight. Initially, our setup involved directly importing CSV data from S3...
0
answers
0
votes
188
views
asked 25 days agolg...
I'm running an EMR Serverless Spark job that uses Delta OSS to handle Delta tables. I previously resolved a configuration issue with EMR Serverless and AWS Glue Data Catalog...
1
answers
0
votes
243
views
asked a month agolg...
Why doesn't Glue Job and Glue Workflow have the function of version control and alias likes Labmda.lg...
I tried to develop the data orchestlation with s3, Glue Job and Glue Workflow. After I developed it, I found that Glue Job and Glue Workflow doesn't have the function of version control and alias...
0
answers
0
votes
170
views
asked a month agolg...
Hi team, first post, let me know if it provides a good explanation.
I'd like to know a way to minimize the effort for data ingestion.
We have two options as follows:
(1) csv files from a file...
0
answers
0
votes
297
views
asked a month agolg...
I get the error "InvalidInputException: Unable to resolve any valid connection" when I test my AWS Glue connection to my mongDB Atlas database.
I can connect with an identical string, user and...
1
answers
0
votes
61
views
asked a month agolg...