Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hi all, I had a quick question regarding AWS Glue Catalog Tables.
I currently have a crawler that is crawling one folder with 3 files of the same schema. If I want to reduce to just 1 file, would I...
1
answers
0
votes
369
views
asked 5 months agolg...
MSK connectors are trying to create s3 sink connectors. At this time, schema uses the schema in the Glue schema registry, and the goal is to store avro schema in s3 in parquet format.
Below is the...
0
answers
0
votes
333
views
asked 5 months agolg...
I have a CTR data in JSON format stored in s3 bucket which has the below column
"SegmentAttributes": {
"connect:Subtype": {
"ValueString": "connect:Telephony"
}
}
Due...
1
answers
0
votes
402
views
asked 5 months agolg...
I want to store the schema for Avro formatted messages in Glue schema registry, and I want to use this schema when reading records from Kinesis data stream.
Currently, for reading records from the...
1
answers
0
votes
683
views
asked 5 months agolg...
Hi all, I need to demonstrate lake formation data filters usage. What is the easiest way to query this data and show the difference caused by filters.
I have 2 roles accessible to my account. One role...
1
answers
0
votes
311
views
asked 5 months agolg...
Hi all, is there any direct way to set up cloudwatch alarms to alert you when a glue job fails? Without using the lambda function. For example, using a direct metric such as...
2
answers
0
votes
740
views
asked 5 months agolg...
Hi all,
We found a bug in Glue triggers when editing a Scheduled typed one with custom cron set.
When we go for a trigger edition the Cron config set before is lost and the interface show us a daily...
0
answers
0
votes
50
views
asked 5 months agolg...
we are using crawler and custom classifier to parse fixed length file.
As part of our requirement, need to extract input file name.
Input files stores into S3 Folder
S3 Folder ----> Crawler (custom...
1
answers
0
votes
228
views
asked 5 months agolg...
During mapping of a few columns from a CSV file in S3 to a Redshift table, I can't change datatype from long to int. The list is empty, and the search is not showing any results either. In the catalog...
2
answers
0
votes
277
views
asked 5 months agolg...
Hey all, I currently have a data file in s3 which i am trying to output to redshift through glue visual studio. My data successfully got sent to redshift tables, but the amount field has changed the...
2
answers
0
votes
235
views
asked 5 months agolg...
Hi, I'm relatively new to AWS glue and i'm having trouble with Glue ETL error.
What makes it strange is that this error is only on Dev env but not on Test env. Same code & configuration!
Also tried to...
1
answers
0
votes
268
views
asked 5 months agolg...
Hey all, I have been trying to perform a simple S3 to redshift data push using an S3 source node and a Amazon Redshift target node.
I have been getting errors such as
'Failed to connect to IP...
4
answers
0
votes
342
views
asked 5 months agolg...