Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
We have enabled the lake formation for some POC and we are unable to disable it and get default setting. The problem we have is if I create a db in athena and to create table in same database using...
1
answers
0
votes
133
views
asked 11 days agolg...
Is there any version control integration for Glue Workflow (orchestration) jobs and triggers?
We primarily use the visual editor and recently accidently deleted a workflow. We need a way to version...
Accepted AnswerAWS Glue
1
answers
0
votes
84
views
asked 12 days agolg...
When creating the temporary table to perform the MERGE in Redshift, I get the error "**String length exceeds DDL length.**" I am using visual ETL. How can I make Redshift use the maximum length for a...
2
answers
0
votes
192
views
asked 12 days agolg...
Hi, I have been trying to find documentation on how to include a column with the Oracle SCN in the DMS task output ...
3
answers
0
votes
89
views
asked 12 days agolg...
I'm experimenting with Amazon DataZone and encountered something unexpected. I have a simple setup with one AWS account and one DataZone domain, which includes:
1 Glue Table
1 S3 bucket with my...
1
answers
0
votes
289
views
asked 12 days agolg...
I'm trying to run this Visual ETL Glue job wich is pretty simple: source node is a Glue Catalog table from RDS MySQL, transform via DataBrew Recipe to replace invalid-special characters, and load to...
1
answers
0
votes
105
views
asked 12 days agolg...
I wrote a python code that uploads data to S3 in csv format daily. I formatted the file name like this: 'some_data_YY_MM_DD.csv'. Using Athena, I want to query from the past 7 days of data.
1. Is...
3
answers
0
votes
651
views
asked 13 days agolg...
Facing the following error when using 2 jobs and 1 crawler:
Job 1: changing the schema and saving the csv file as parquet in S3.
Job 2: ETL Process
Crawler: Saving it in the AWs Glue Datacatalog...
1
answers
0
votes
607
views
asked 13 days agolg...
Currently, I am using AWS Glue to extract data from Mongo DB and push alll data to json file in S3 service. I use **create_dynamic_frame** function to extract data from MongoDB and use...
2
answers
0
votes
112
views
asked 14 days agolg...
I'm creating a role in AWS Glue to read CSV files from an S3 bucket. I'm granting full access to S3, but I can't seem to avoid this error. I contacted support, and they suggested increasing the usage...
0
answers
0
votes
62
views
asked 17 days agolg...
Hi,
I have a Glue which reads data from Database and database connection details like host, user name and password are stored in AWS secret manager. We have environment specific AWS secret manager...
1
answers
0
votes
58
views
asked 17 days agolg...
AWS Glue 4.0 support Apache Hudi 0.12.1 version. What steps can I follow to upgrade the version of Hudi to 0.14 in AWS Glue 4.0
2
answers
0
votes
77
views
asked 18 days agolg...