Unanswered Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
1. I am trying to understand how to estimate the end result of pricing for Glue crawlers for data being ingested by AWS Kinesis Firehose service with the max possible buffer setting while glue...
0
answers
0
votes
170
views
asked 6 months agolg...
I have a Glue table created from schema in Glue schema registry that is in JSON draft 07 format.
I tried setting up a Firehose that converts incoming JSON data into Parquet as it saves it into S3,...
0
answers
0
votes
194
views
asked 6 months agolg...
when I launch an aws GLUE crawler on files in CSV format, the crawler does not detect some files as CSV, in stackoverflow I read that it is because the crawler uses LazySimpleSerde and needs at least...
0
answers
0
votes
109
views
I have set up and am using the Spark history server for AWS Glue as described here:
https://docs.aws.amazon.com/glue/latest/dg/monitor-spark-ui-history.html
However, this application is not able to...
0
answers
0
votes
64
views
asked 7 months agolg...
Hi Team,
I have setup CUR via Billing Export to s3 and querying data in Athena via AWS Glue Crawler. I did few transformations via AWS Glue ETL and want to store the transformed data incrementally to...
0
answers
0
votes
663
views
asked 7 months agolg...
Since a day before yesterday, AWS Glue Studio appears do not working anymore.
Looking at javascript console error I found this:
![javascript...
0
answers
0
votes
24
views
asked 7 months agolg...
curious has anyone done a baseline comparison of cost/performance (using same dataset and spark transformations) b/w SageMaker Processing Job (Spark container) vs an AWS Glue Job (Spark) ?
Looking at...
0
answers
0
votes
73
views
asked 7 months agolg...
I created an Athena table using Glue
```
import * as glue from '@aws-cdk/aws-glue-alpha'
const dataWarehouse = new glue.Table(this, `data_warehouse`, {
database: db,
tableName:...
0
answers
0
votes
83
views
asked 7 months agolg...
A few days ago jobs list is completely disapperared.
Google Chrome with last updates, Macbook Intel i9 with last updates (Sonoma).
I tried to clear cache, cookies, login from Incognito mode, disable...
0
answers
0
votes
83
views
asked 7 months agolg...
I am using Glue Crawler to crawl for parquet files, partitioned by type/yyyy/mm/dd which has been working just great. However, we have just run into a scenario where we need to rename a column. Is it...
0
answers
0
votes
113
views
asked 7 months agolg...
My Glue 4.0 jobs have suddenly stopped working with error message below. As it is related to boto3, I am unable to make any changes to library config. Pls advise.
NB: I noticed that urllib3 released...
0
answers
0
votes
96
views
asked 7 months agolg...
There are two types of use cases for the CustomSQL rule. In my case, I want to use a rule of the Custom SQL to retrieve row-level results type. For example: CustomSql "select Name from primary where...
0
answers
0
votes
56
views
asked 7 months agolg...