Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hi all, I am trying to implement lake formation security on my data lake consisting of bronze, silver, gold zones in s3 and glue catalog tables. The gold zone data also exists in redshift tables with...
1
answers
0
votes
380
views
asked 5 months agolg...
Hello
I am trying to create a protected view following https://docs.aws.amazon.com/athena/latest/ug/views-glue.html
I created a simple Athena table backed by an s3 stored csv file.
The table looks...
1
answers
1
votes
192
views
asked 5 months agolg...
Hi Team,
I have a task to execute glue jobs from third party scheduler.
To accomplish this, is it possible to expose AWS Glue jobs as REST api so that job can be invoked from third party scheduler...
1
answers
0
votes
255
views
asked 5 months agolg...
I'm trying to customize a script built via **Visual ETL** and came across a error
Steps I followed
* A DynamicFrame created from csv file present in s3 needs to be evaluated for its data-type
* I'm...
1
answers
0
votes
286
views
asked 5 months agolg...
Hi all, I had a quick question regarding AWS Glue Catalog Tables.
I currently have a crawler that is crawling one folder with 3 files of the same schema. If I want to reduce to just 1 file, would I...
1
answers
0
votes
373
views
asked 5 months agolg...
MSK connectors are trying to create s3 sink connectors. At this time, schema uses the schema in the Glue schema registry, and the goal is to store avro schema in s3 in parquet format.
Below is the...
0
answers
0
votes
334
views
asked 5 months agolg...
I have a CTR data in JSON format stored in s3 bucket which has the below column
"SegmentAttributes": {
"connect:Subtype": {
"ValueString": "connect:Telephony"
}
}
Due...
1
answers
0
votes
407
views
asked 5 months agolg...
I want to store the schema for Avro formatted messages in Glue schema registry, and I want to use this schema when reading records from Kinesis data stream.
Currently, for reading records from the...
1
answers
0
votes
687
views
asked 5 months agolg...
Hi all, I need to demonstrate lake formation data filters usage. What is the easiest way to query this data and show the difference caused by filters.
I have 2 roles accessible to my account. One role...
1
answers
0
votes
313
views
asked 5 months agolg...
Hi all, is there any direct way to set up cloudwatch alarms to alert you when a glue job fails? Without using the lambda function. For example, using a direct metric such as...
2
answers
0
votes
747
views
asked 5 months agolg...
Hi all,
We found a bug in Glue triggers when editing a Scheduled typed one with custom cron set.
When we go for a trigger edition the Cron config set before is lost and the interface show us a daily...
0
answers
0
votes
50
views
asked 5 months agolg...
we are using crawler and custom classifier to parse fixed length file.
As part of our requirement, need to extract input file name.
Input files stores into S3 Folder
S3 Folder ----> Crawler (custom...
1
answers
0
votes
231
views
asked 5 months agolg...