Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I have a scenario where I need to move data from S3 to a Postgres database running on an EC2 instance. All of this is part of cdk app so I'm looking to add this as a step to the current step function....
1
answers
0
votes
246
views
asked a month agolg...
I'm unable to remove null rows in data using aws glue in either ways via visual or script...my data is getting un transformed even after running the schema
Accepted AnswerAWS Glue
1
answers
0
votes
143
views
asked a month agolg...
Is there any plan/ETA for bringing Spark 3.5 to AWS Glue. Is there any public roadmap?
2
answers
0
votes
140
views
asked a month agolg...
I am trying to use WHL file which contains all the packages and glue connection for etl job, The job is not getting initiliaze and is not populating or creating the logs and job run remains in running...
1
answers
0
votes
125
views
asked a month agolg...
AWS Glue DataBrewlg...
Hello All ,
I am trying to clean up my dataset see below ![Dataset](/media/postImages/original/IMlISUqk8QRVCZTKGDM3uwcA).
I want to remove the first row since the name is invalid and want to add it...
0
answers
0
votes
104
views
asked a month agolg...
I have created an External Table using Redshift Spectrum and using AWS Glue to crawl deeply nested json files coming into s3 bucket every second.
I was able to populate a redshift table by...
2
answers
0
votes
188
views
asked a month agolg...
I'm testing the use of MSK Connect with IcebergSinkConnector, but I'm having some difficulty making it work. If anyone has experience with MSK and can help me, that would be great.
I have a topic in...
2
answers
0
votes
161
views
asked a month agolg...
We have problem in determining that if a VPC Endpoint can be use by multiple AWS services. Lets say I have a S3 bucket endpoint and currently AWS Transfer Family is using it, then I want to use AWS...
1
answers
0
votes
757
views
asked a month agolg...
I have some json files being loaded to s3 and the events are being queued to sqs, I need to copy the information to redshift, I want to know if there is a way to load it directly from the sqs or if I...
2
answers
0
votes
372
views
asked a month agolg...
I have a parallelized python script running in containers which transforms data and writes it to S3 with updates to the Glue catalog. Each container runs several tasks in parallel and the overall data...
2
answers
0
votes
123
views
asked a month agolg...
I am using AWS Glue 4.0 (Pyspark) to get data from several MongoDB Atlas collections, using the GlueContext.create_dynamic_frame.from_options method. For all collections except one it has worked fine...
2
answers
0
votes
115
views
asked a month agolg...
Loading class `com.mysql.jdbc.Driver'. This is deprecated. The new driver class is `com.mysql.cj.jdbc.Driver'. The driver is automatically registered via the SPI and manual loading of the driver class...
1
answers
0
votes
190
views
asked a month agolg...