Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hi folks!
I want to ask can we do insert-update in AWS Glue Visual ETL Job?
I want to use Postgre as DB target and will do insert-update.
Prefers use Visual ETL Job...
1
answers
0
votes
363
views
asked 4 months agolg...
Which service among AWS DMS, AWS Glue and AWS Kinesis is cheap and efficient for replication of large amount data between two AWS account?
My main focus is to lower the cost for replication of...
2
answers
0
votes
647
views
asked 4 months agolg...
I am trying to load geopandas library in Glue job , I have tried below approaches.
1. Creating geopandas python wheel and adding it Job Details -->Libraries-->Python library...
2
answers
0
votes
137
views
asked 4 months agolg...
Hi folks!
right now i'm working on project to do ETL Process using AWS Glue. I already create the query script to process the data, but my source data is in Json format. I need help to transform the...
1
answers
0
votes
230
views
asked 4 months agolg...
When creating a QuickSight Dataset using CDK, we have to specify the input_columns parameter for physical_table_map. Is there a way to include all columns in the table without having to write out all...
1
answers
0
votes
423
views
asked 4 months agolg...
Hello... I have a query regarding the conversion of Protobuf objects stored in an S3 bucket (I possess a list of .pb.gz objects within the "Origin" bucket). I aim to develop a Glue job to transform...
2
answers
0
votes
156
views
asked 4 months agolg...
Hello!
I am using Redshift Serverless and am having some difficulty with auto-complete. This understandably leads to tedious typing of queries and introduces unneeded typos.
We have several...
1
answers
0
votes
437
views
asked 4 months agolg...
This is a followup question to the post https://repost.aws/questions/QUzURnlUzOR9mfoQbiLwCNvA/incremental-data-capture-from-dynamodb-to-s3
With PITR feature in DDB, is it possible to incrementally...
1
answers
0
votes
506
views
asked 4 months agolg...
I am running a Glue ETL job to load data from parquet file from S3 into Redshift table.
![Enter image description here](/media/postImages/original/IMrrvRKNfNQ0604h-FuKYtFQ)
I am able to get data...
2
answers
0
votes
306
views
asked 4 months agolg...
I am facing an error in my glue job while accessing the huge volume of data from the source[Aurora MySQl].
```
[Error] The table '/rdsdbdata/tmp/#sql104_24f40a_0' is full
```
I want to know the root...
1
answers
0
votes
304
views
asked 4 months agolg...
I have uploaded two separate csv files (just to check the query results) with the tables in the right order and values in S3, but everytime I run the crawler and view the individual table data in...
1
answers
0
votes
214
views
asked 4 months agolg...
I'm trying to fetch Glue Catalogue tables from Spark on EKS cluster,
added to spark configuration:
```
"spark.hadoop.hive.metastore.client.factory.class":...
1
answers
0
votes
98
views
asked 4 months agolg...