Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I am running a Glue ETL job to load data from parquet file from S3 into Redshift table.
![Enter image description here](/media/postImages/original/IMrrvRKNfNQ0604h-FuKYtFQ)
I am able to get data...
2
answers
0
votes
338
views
asked 5 months agolg...
I am facing an error in my glue job while accessing the huge volume of data from the source[Aurora MySQl].
```
[Error] The table '/rdsdbdata/tmp/#sql104_24f40a_0' is full
```
I want to know the root...
1
answers
0
votes
410
views
asked 5 months agolg...
I have uploaded two separate csv files (just to check the query results) with the tables in the right order and values in S3, but everytime I run the crawler and view the individual table data in...
1
answers
0
votes
243
views
asked 5 months agolg...
I'm trying to fetch Glue Catalogue tables from Spark on EKS cluster,
added to spark configuration:
```
"spark.hadoop.hive.metastore.client.factory.class":...
1
answers
0
votes
119
views
asked 5 months agolg...
Hi, I was trying to implement a system on AWS. The system has one account A (not root) in an organization.
**Problem**: Account A has an S3 bucket and I need to create a Glue Crawler to read S3...
1
answers
0
votes
314
views
asked 5 months agolg...
After creating my DataZone domain I'm trying to import a new Data Source from glue to publish it to the catalog and I'm getting the following error:
![Enter image description...
2
answers
0
votes
263
views
asked 5 months agolg...
Hello,
I was able to create and register a new Iceberg table in my data catalog and Lake Formation using a Glue Job. I used these methods from the...
1
answers
0
votes
278
views
asked 6 months agolg...
I am trying to have glue data catalog as the hive metastore, stood up the EMR(emr-6.15.0) with the following node classification config per AWS, and it always initialize a default glue catalog...
1
answers
0
votes
484
views
asked 6 months agolg...
Hello,
I am trying to add a column to a data set as part of a transformation in an AWS Glue job. I am developing my script locally using interactive sessions and in my session I can see that the code...
1
answers
0
votes
464
views
asked 6 months agolg...
We are exploring AWS Glue for our use case implementation. It's a great tool for ETL Jobs.
However, when supporting the complex transformations......... GUI editor is not supporting it and switched...
1
answers
0
votes
173
views
asked 6 months agolg...
In a Glue streaming job, is it possible read from Multiple Kinesis sources in my spark script?
something like:
```
streams = ["streamA", "streamB"]
for stream in streams:
...
3
answers
0
votes
676
views
asked 6 months agolg...
I'm trying to run glue job that join 3 mysql tables as data source and insert that data into redshift as data target, but facing this error that says
"Error Category: UNCLASSIFIED_ERROR; An error...
1
answers
0
votes
1417
views
asked 6 months agolg...