Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
If we enable "Job Metrics" for Glue, are these considered "Custom" metrics that are subject to the pricing here:
https://aws.amazon.com/cloudwatch/pricing/
1
answers
0
votes
16
views
asked 3 hours agolg...
Hi I have created an external table on AWS Glue catalog db .
The table points to a lz4 compressed file on an s3.
the table definition looks like this
```
CREATE EXTERNAL TABLE `myapplogs`(
...
0
answers
0
votes
18
views
asked 4 hours agolg...
Hello,
I have a Glue table based on parquet files in S3 that is partitioned by 3 columns:
- event_date_year
- event_date_month
- event_date_day
I want to select data for a list of given event...
1
answers
0
votes
19
views
asked 3 days agolg...
"In my AWS Glue job, I've configured an ETL process to extract data from the Data Catalog, apply a transformation to detect Personally Identifiable Information (PII), and then store the transformed...
1
answers
0
votes
20
views
asked 3 days agolg...
Hi Everyone
Glad to get here and write you. I'm just staring with AWS with experience from Azure. I'm learnin Amazon Flue from Udemy, and when I try to create a crawler to scan my S3 objects I got a...
2
answers
0
votes
33
views
asked 3 days agolg...
Hello AWS Community,
I'm facing a challenging issue with our AWS data pipeline that affects data visualization in Amazon QuickSight. Initially, our setup involved directly importing CSV data from S3...
0
answers
0
votes
30
views
asked 3 days agolg...
I'm running an EMR Serverless Spark job that uses Delta OSS to handle Delta tables. I previously resolved a configuration issue with EMR Serverless and AWS Glue Data Catalog...
0
answers
0
votes
97
views
asked 4 days agolg...
Why doesn't Glue Job and Glue Workflow have the function of version control and alias likes Labmda.lg...
I tried to develop the data orchestlation with s3, Glue Job and Glue Workflow. After I developed it, I found that Glue Job and Glue Workflow doesn't have the function of version control and alias...
0
answers
0
votes
41
views
asked 4 days agolg...
Hi team, first post, let me know if it provides a good explanation.
I'd like to know a way to minimize the effort for data ingestion.
We have two options as follows:
(1) csv files from a file...
0
answers
0
votes
96
views
asked 4 days agolg...
I get the error "InvalidInputException: Unable to resolve any valid connection" when I test my AWS Glue connection to my mongDB Atlas database.
I can connect with an identical string, user and...
1
answers
0
votes
40
views
asked 5 days agolg...
Kinesis Firehose allows to configure S3 as a destination and in the Parquet section allows selecting a Glue catalog table of format Iceberg. However I had little to no luck querying the data.
Does...
1
answers
0
votes
48
views
asked 5 days agolg...
I am trying to connect AWS glue crawler with a postgres db on RDS. Both the crawler and DB are in the same region. steps followed:
1. created a connection with jdbc url username and...
1
answers
0
votes
65
views
asked 5 days agolg...