Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I'd be grateful for a clue on how to craft a connection string for AWS Glue to connect to a SQL Server Always on AG using the Microsoft JDBC Drivers. I'm trying to use this bring your own driver...
0
answers
0
votes
68
views
asked 5 hours agolg...
I am trying to add a default to an existing field in an Avro schema in AWS Glue, but the change isn't registering as a new version.
Is this behavior expected? If so, why? If not, how can I go about...
0
answers
0
votes
50
views
asked 13 hours agolg...
I have data that I collect from AWS Batch and CloudWatch. I made a lambda function that runs every day that collects those data daily and saves the result to S3. I have a folder called 'logs' and the...
0
answers
0
votes
181
views
asked 2 days agolg...
We have enabled the lake formation for some POC and we are unable to disable it and get default setting. The problem we have is if I create a db in athena and to create table in same database using...
1
answers
0
votes
67
views
asked 2 days agolg...
Is there any version control integration for Glue Workflow (orchestration) jobs and triggers?
We primarily use the visual editor and recently accidently deleted a workflow. We need a way to version...
Accepted AnswerAWS Glue
1
answers
0
votes
54
views
asked 2 days agolg...
When creating the temporary table to perform the MERGE in Redshift, I get the error "**String length exceeds DDL length.**" I am using visual ETL. How can I make Redshift use the maximum length for a...
2
answers
0
votes
68
views
asked 2 days agolg...
Hi, I have been trying to find documentation on how to include a column with the Oracle SCN in the DMS task output ...
3
answers
0
votes
57
views
asked 3 days agolg...
I'm experimenting with Amazon DataZone and encountered something unexpected. I have a simple setup with one AWS account and one DataZone domain, which includes:
1 Glue Table
1 S3 bucket with my...
0
answers
0
votes
163
views
asked 3 days agolg...
I'm trying to run this Visual ETL Glue job wich is pretty simple: source node is a Glue Catalog table from RDS MySQL, transform via DataBrew Recipe to replace invalid-special characters, and load to...
1
answers
0
votes
87
views
asked 3 days agolg...
I wrote a python code that uploads data to S3 in csv format daily. I formatted the file name like this: 'some_data_YY_MM_DD.csv'. Using Athena, I want to query from the past 7 days of data.
1. Is...
3
answers
0
votes
327
views
asked 4 days agolg...
Facing the following error when using 2 jobs and 1 crawler:
Job 1: changing the schema and saving the csv file as parquet in S3.
Job 2: ETL Process
Crawler: Saving it in the AWs Glue Datacatalog...
1
answers
0
votes
316
views
asked 4 days agolg...
Currently, I am using AWS Glue to extract data from Mongo DB and push alll data to json file in S3 service. I use **create_dynamic_frame** function to extract data from MongoDB and use...
1
answers
0
votes
82
views
asked 5 days agolg...