Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
AWS Glue DataBrewlg...
Hello All ,
I am trying to clean up my dataset see below ![Dataset](/media/postImages/original/IMlISUqk8QRVCZTKGDM3uwcA).
I want to remove the first row since the name is invalid and want to add it...
1
answers
0
votes
123
views
asked 2 months agolg...
I have created an External Table using Redshift Spectrum and using AWS Glue to crawl deeply nested json files coming into s3 bucket every second.
I was able to populate a redshift table by...
2
answers
0
votes
224
views
asked 2 months agolg...
I'm testing the use of MSK Connect with IcebergSinkConnector, but I'm having some difficulty making it work. If anyone has experience with MSK and can help me, that would be great.
I have a topic in...
2
answers
0
votes
267
views
asked 2 months agolg...
We have problem in determining that if a VPC Endpoint can be use by multiple AWS services. Lets say I have a S3 bucket endpoint and currently AWS Transfer Family is using it, then I want to use AWS...
1
answers
0
votes
911
views
asked 2 months agolg...
I have some json files being loaded to s3 and the events are being queued to sqs, I need to copy the information to redshift, I want to know if there is a way to load it directly from the sqs or if I...
2
answers
0
votes
422
views
asked 2 months agolg...
I have a parallelized python script running in containers which transforms data and writes it to S3 with updates to the Glue catalog. Each container runs several tasks in parallel and the overall data...
2
answers
0
votes
151
views
asked 2 months agolg...
I am using AWS Glue 4.0 (Pyspark) to get data from several MongoDB Atlas collections, using the GlueContext.create_dynamic_frame.from_options method. For all collections except one it has worked fine...
2
answers
0
votes
156
views
asked 2 months agolg...
Loading class `com.mysql.jdbc.Driver'. This is deprecated. The new driver class is `com.mysql.cj.jdbc.Driver'. The driver is automatically registered via the SPI and manual loading of the driver class...
1
answers
0
votes
276
views
asked 3 months agolg...
ERROR StatusLogger Unrecognized conversion specifier [n] starting at position 56 in conversion pattern.
Note: i have already created s3 endpoint in same vpc i am currently working on, also created...
1
answers
0
votes
222
views
asked 3 months agolg...
Hi AWS, I was querying Cost and Usage Reports (CURs) using Athena. By default a CloudFormation template gets created and it gets stored inside the bucket where the report is getting stored, however...
1
answers
0
votes
1014
views
asked 3 months agolg...
I am wondering what is the best way to pull data front external APIs using AWS services to store it in S3, dynamodb or RDS in a periodic way.
Is it lambda? Glue? Eventbridge? Appflow with custom...
2
answers
0
votes
320
views
asked 3 months agolg...
When other AWS users are trying to access my bucket with their crawler, they are getting the below error.
"Crawler Error:
User does not have access to target s3://test-bucket-mis6389/evdata/"
My s3...
5
answers
0
votes
522
views
asked 3 months agolg...