Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Just curious when will AWS Glue support Java 11 or Java 17? AWS Glue 4.0 only supports Java 8 so far and due to this our project can't use the new features of Java 11.
1
answers
0
votes
540
views
asked 4 months agolg...
I am trying to connect to an external s3 bucket as a data source for a glue crawler. The bucket has the necessary arn permissions as i can connect to it via s3 browser as an external bucket. The...
1
answers
0
votes
623
views
asked 4 months agolg...
I have a Delta Lake table saved in s3. I am running the following command:
spark.sql("""
CREATE EXTERNAL TABLE db.my_table
USING DELTA
LOCATION 's3://path/to/delta/table
""")
Everything...
2
answers
0
votes
371
views
asked 4 months agolg...
Hi there,
I am trying to establish ETL processing from our existing AWS Kinesis data stream to snowflake. We are currently using KCL which is extremely difficult to maintain as we do not have the...
1
answers
0
votes
1466
views
asked 4 months agolg...
I've loaded some CSV files from an S3 bucket into tables in a Glue DB. I'm trying to query the tables using Athena, but I keep getting this...
1
answers
0
votes
390
views
asked 4 months agolg...
Hello.
I am currently completing the AWS Industry Quest: Financial Industry but I'm unable to do so as 2 modules produce errors that prevent me from continuing. The modules "Securing a Banking Data...
1
answers
0
votes
464
views
asked 5 months agolg...
This error: `Service: AWSGlue; Status Code: 400; Error Code: AccessDeniedException`
I have an organisation account, I have access to the root user, but I'm trying to deploy using a PowerUser. I have...
0
answers
0
votes
131
views
asked 5 months agolg...
I'm converting my json files with dynamic schema to Parquet and used a Glue Crawler to create Glue Table to query using Athena. I got the below error as one column in my table got array<string> in one...
2
answers
0
votes
388
views
asked 5 months agolg...
I have a strange problem.
I created my first Visual ETL job; it runs fine, but there are a few mistakes in the output schema.
The problem is now when I try to open the job, it will not load in...
2
answers
0
votes
340
views
asked 5 months agolg...
Hi folks!
I want to ask can we do insert-update in AWS Glue Visual ETL Job?
I want to use Postgre as DB target and will do insert-update.
Prefers use Visual ETL Job...
1
answers
0
votes
389
views
asked 5 months agolg...
Which service among AWS DMS, AWS Glue and AWS Kinesis is cheap and efficient for replication of large amount data between two AWS account?
My main focus is to lower the cost for replication of...
2
answers
0
votes
658
views
asked 5 months agolg...
I am trying to load geopandas library in Glue job , I have tried below approaches.
1. Creating geopandas python wheel and adding it Job Details -->Libraries-->Python library...
2
answers
0
votes
149
views
asked 5 months agolg...