Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Glue Job - S3 to S3lg...
Hi Team,
I am working on Glue to job to copy/move file from one bucket to another bucket. Could you please help me with your thoughts
1. Using Python how to copy/move the unzipped file to target...
0
answers
0
votes
83
views
asked a month agolg...
Following this post: https://repost.aws/knowledge-center/glue-reduce-cloudwatch-logs
I have created the following glue job:
```
from awsglue.context import GlueContext
from pyspark.context import...
1
answers
0
votes
88
views
asked a month agolg...
Hi,
I am testing Amazon DataZone features and therefore set up a domain together with another associated account.
I enabled the DataLake blueprint in both accounts. I have 2 projects (producer,...
2
answers
0
votes
112
views
asked a month agolg...
Hi,
I am runing a Spark ETL glue job and want to see how the executor's log through Spark UI. However, I didn't see the executor logs like stderr and stdout. Can you please advise how to find the...
2
answers
0
votes
117
views
asked a month agolg...
I can't use my personal root account to create Glue job or Glue Crawler
got such as
Failed to update job
[gluestudio-service.ap-southeast-1.amazonaws.com] createJob: AccessDeniedException: Account...
2
answers
0
votes
141
views
asked a month agolg...
My company is pushing to have everything "As Code" and I was wondering which tool is better for us.
Since we are not allowed to use the Glue interface to create ETLs, to configure the settings, and...
1
answers
0
votes
108
views
asked a month agolg...
Hello!
I am new to AWS Glue and I starting to create data monitoring rules in AWS Glue. I have tried multiple options with CustomSQL but can not seem to find the solution.
My problem: I want to check...
1
answers
0
votes
164
views
asked a month agolg...
Hello,
We have an AWS Glue Workflow that triggers a a lot of jobs, but eventually, out of the blue an error occurs in the workflow that doesn't generate any logs:
Workflow run metadata size...
Accepted AnswerAWS Glue
1
answers
0
votes
98
views
asked a month agolg...
Hi, basically what title says. Data connections test and crawlers work fine. I've tried enabling SSL, adding ''?enabledTLSProtocols=TLSv1.2' to connection string. Both did not help. CA on the rds is...
1
answers
1
votes
105
views
asked a month agolg...
I am trying to create a Glue job for migrating data from BigQuery to an S3 bucket. I have created a BigQuery connection in AWS Glue. The connection uses the Secret Id to reference a secret name in AWS...
1
answers
0
votes
120
views
asked 2 months agolg...
Getting error while connecting streaming data from kinesis to redshift with few transformations using visual ETL. (using amazon kinesis - glue data catalog table as source ). Schema is already...
1
answers
0
votes
211
views
asked 2 months agolg...
I have created a glue trigger using cdk. My question is how can I deactivate this trigger using CDK. Here is my code -
```
const myTrigger = new CfnTrigger(this,`my-trigger-dev`, {
name:...
1
answers
0
votes
185
views
asked 2 months agolg...