Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I have a parallelized python script running in containers which transforms data and writes it to S3 with updates to the Glue catalog. Each container runs several tasks in parallel and the overall data...
2
answers
0
votes
148
views
asked 2 months agolg...
I am using AWS Glue 4.0 (Pyspark) to get data from several MongoDB Atlas collections, using the GlueContext.create_dynamic_frame.from_options method. For all collections except one it has worked fine...
2
answers
0
votes
152
views
asked 2 months agolg...
Loading class `com.mysql.jdbc.Driver'. This is deprecated. The new driver class is `com.mysql.cj.jdbc.Driver'. The driver is automatically registered via the SPI and manual loading of the driver class...
1
answers
0
votes
267
views
asked 2 months agolg...
ERROR StatusLogger Unrecognized conversion specifier [n] starting at position 56 in conversion pattern.
Note: i have already created s3 endpoint in same vpc i am currently working on, also created...
1
answers
0
votes
217
views
asked 2 months agolg...
Hi AWS, I was querying Cost and Usage Reports (CURs) using Athena. By default a CloudFormation template gets created and it gets stored inside the bucket where the report is getting stored, however...
1
answers
0
votes
993
views
asked 2 months agolg...
I am wondering what is the best way to pull data front external APIs using AWS services to store it in S3, dynamodb or RDS in a periodic way.
Is it lambda? Glue? Eventbridge? Appflow with custom...
2
answers
0
votes
307
views
asked 2 months agolg...
When other AWS users are trying to access my bucket with their crawler, they are getting the below error.
"Crawler Error:
User does not have access to target s3://test-bucket-mis6389/evdata/"
My s3...
5
answers
0
votes
519
views
asked 2 months agolg...
I need to replicate an iceberg datalake stored in S3 from one bucket to another. However, multi-region access point doesn't work with Athena table. And I don't see any pyspark procedure that could...
1
answers
0
votes
424
views
asked 3 months agolg...
When creating a table with a leading space in the name, AWS Glue does not display any error during the creation process. However, upon checking the API logs, I noticed that the space is present in the...
1
answers
0
votes
455
views
asked 3 months agolg...
Hello,
I new at glue and created a job to extract the content on a table in oracle (on premise) to S3, the oracle conection is sucessfull but whe trying to write to S3 it says:
An error occurred...
4
answers
0
votes
128
views
asked 3 months agolg...
I need to fetch files that has arrived current_time - 1hr from my S3 bucket for processing. My files name will be in format yyyymmdd-hhmmsssss.parquet (includes milli seconds also). So I am running a...
1
answers
0
votes
427
views
asked 3 months agolg...
Hello AWS Support and Forum,
basic free tier account for some unknown reason. I've tried different regions and I still get the same 'AccessDeniedException: Account id... is denied access.' error! for...
2
answers
0
votes
145
views
asked 3 months agolg...