Explore how you can quickly prepare for, respond to, and recover from security events. Learn more.
All Content tagged with AWS Glue
AWS Glue is a serverless data integration service that makes it easy to discover, prepare, and combine data for analytics, machine learning, and application development.
Content language: English
Select up to 5 tags to filter
Sort by most recent
1848 results
I see there is a change to now support requirements.txt files, however we still prefer to load our internal wheel files via S3 buckets. In Glue 4.0 we were doing this via
a key of '--additional-pytho...
Hi there!
We want to set up a mechanism to copy the new data added to an RDS PostgreSQL database to a Supabase (either self-hosted in EC2 or cloud-hosted from Supabase) database and vice-versa.
I tr...
asked 2 days ago
Hi,
I am trying to follow this https://docs.aws.amazon.com/glue/latest/dg/interactive-sessions-vscode.html. However, there is no vscode plugin called "AWS Glue interactive sessions" on the market. I ...
Following error is shown when creating a Redshift connection.
> Create connection failed during validating credentials. Please validate connection inputs and VPC connectivity to Security Token Service...
Hello AWS Community,
I'm aiming to improve the user experience for our team when querying data in Amazon Athena. Specifically, I want to display the most recent data update time, based on the actual ...
Im trying to connect Azure SQL server as source for AWS Glue jobs.
During preview, I am faced with error for the IP not being able to access the server. Noticed that the Client IP of AWS Glue keeps ...
Im trying to install and use a Python package that is not native in AWS Glue Visual ETL - Custom Transform node.
!pip install textdistance -> !pip is invalid syntax in the Custom Transform code
Wo...
We have been trying Firehose for Iceberg Tables. The source is Kinesis stream attached to DynamoDB tables with some Lambda processing in between.
Table has been successfully filled by Firehose, but ...
I am having customSQL rules for Glue data quality check along with the recommended rules. While calling start_data_quality_ruleset_evaluation_run, i am also passing pushDownPredicate for 'enddate' par...
asked 8 days ago
Running a Glue Crawler on json file with this structure:
[
{
"SoldTo": "647218",
"ContainerId": 1691340,
"Container": "Per Åges Badelandcontainer 2",
"ContainerRe...
**Problem Description**:
I need to create a metadata mapping layer in AWS Glue for DynamoDB items without crawling the entire table. The goal is to enable querying DynamoDB through Athena while not kn...
I'm trying to reproduce the exercise in the link below, from the AWS Glue Immersion day workshop, but I'm having a problem with a rule recommendation failure in Glue Data Quality, due to an ambiguous ...