All Content tagged with AWS Glue
AWS Glue is a serverless data integration service that makes it easy to discover, prepare, and combine data for analytics, machine learning, and application development.
Content language: English
Filter content
Select tags to filter
Sort by
Sort by most recent
2170 results
Hi team,
I’m observing a strange behavior with AI-generated metadata in AWS DataZone.
We have two tables with similar structures (Both Glue Tables with no specific difference). For one of them, the ...
Hi,
We have an AWS Glue streaming job that runs 24x7 and consumes messages from MSK. Yesterday, the job started failing during batch processing with the following exception:
```
ERROR GlueLogger: B...
Hi Everyone!
I have an iceberg table with +999 files in data folder and metadata as well. I have enabled Optimization option in Glue in order to compact small files into larger, as well as snapshots r...
I'm trying to set up the Glue and Redshift connection. I created several endpoints for S3, Redshift, KMS, and Secret Manager, but I'm getting this error. I don't understand where this VPC value was co...
Hi! I am trying to create iceberg table on AWS from an ECS container using pyiceberg. The role for the ECS has access to s3 bucket and KMS policy. We use this role for other tasks and it can write wit...
I am using KDS which pushes to Kinesis Data Firehose which loads data into my S3 bucket.
My S3 bucket is currently structured as follows:
s3://bucket_name/anyCompany/year/month/day/hour/jsonFiles
Eac...
asked 7 months ago
Please find the two DQDL rules I am trying to formate. They are not working as desired. Please let me know if there is any issue with the syntax.
- check_type: "DQDL"
check: CustomSql "SELECT a,b...
We use Amazon Redshift as our main data warehouse and want to adopt dbt Mesh to enable cross-platform data sharing between Redshift and Snowflake.
Currently, dbt Mesh depends on Apache Iceberg as the...
I am writing a simple AWS Glue ETL job as a Python script which reads a record from a Snowflake table and updates the corresponding record in Salesforce. However, I am getting the following error "Err...
I'm experiencing a critical issue with AWS Glue Studio's Data Preview functionality and Interactive Sessions.
**Problem Description**
Service: AWS Glue (Interactive Sessions / Data Preview)
Region:...
Hi
I am using Glue 5.0. I have updated the job configuration to export lineage. However in Datazone I don't see the column level lineage. Given below is sample code and configs for reference.
from...
Hello everyone,
I'm currently trying to create a connection to Amazon Redshift ServerLess using AWS Glue Studio, but I'm encountering the following error:
`Failed to create connection: InvalidInputE...