Unanswered Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I have a Glue table created from schema in Glue schema registry that is in JSON draft 07 format.
I tried setting up a Firehose that converts incoming JSON data into Parquet as it saves it into S3,...
0
answers
0
votes
190
views
asked 6 months agolg...
when I launch an aws GLUE crawler on files in CSV format, the crawler does not detect some files as CSV, in stackoverflow I read that it is because the crawler uses LazySimpleSerde and needs at least...
0
answers
0
votes
109
views
I have set up and am using the Spark history server for AWS Glue as described here:
https://docs.aws.amazon.com/glue/latest/dg/monitor-spark-ui-history.html
However, this application is not able to...
0
answers
0
votes
63
views
asked 6 months agolg...
Hi Team,
I have setup CUR via Billing Export to s3 and querying data in Athena via AWS Glue Crawler. I did few transformations via AWS Glue ETL and want to store the transformed data incrementally to...
0
answers
0
votes
661
views
asked 6 months agolg...
Since a day before yesterday, AWS Glue Studio appears do not working anymore.
Looking at javascript console error I found this:
![javascript...
0
answers
0
votes
24
views
asked 7 months agolg...
curious has anyone done a baseline comparison of cost/performance (using same dataset and spark transformations) b/w SageMaker Processing Job (Spark container) vs an AWS Glue Job (Spark) ?
Looking at...
0
answers
0
votes
73
views
asked 7 months agolg...
I created an Athena table using Glue
```
import * as glue from '@aws-cdk/aws-glue-alpha'
const dataWarehouse = new glue.Table(this, `data_warehouse`, {
database: db,
tableName:...
0
answers
0
votes
83
views
asked 7 months agolg...
A few days ago jobs list is completely disapperared.
Google Chrome with last updates, Macbook Intel i9 with last updates (Sonoma).
I tried to clear cache, cookies, login from Incognito mode, disable...
0
answers
0
votes
82
views
asked 7 months agolg...
I am using Glue Crawler to crawl for parquet files, partitioned by type/yyyy/mm/dd which has been working just great. However, we have just run into a scenario where we need to rename a column. Is it...
0
answers
0
votes
112
views
asked 7 months agolg...
My Glue 4.0 jobs have suddenly stopped working with error message below. As it is related to boto3, I am unable to make any changes to library config. Pls advise.
NB: I noticed that urllib3 released...
0
answers
0
votes
95
views
asked 7 months agolg...
There are two types of use cases for the CustomSQL rule. In my case, I want to use a rule of the Custom SQL to retrieve row-level results type. For example: CustomSql "select Name from primary where...
0
answers
0
votes
56
views
asked 7 months agolg...
I was trying to perform Glue ETL transformation and store it in AWS Serverless Redshift database and S3 (both) . However, even the Console generated PySpark sheet fails. Almost none of the methods...
0
answers
0
votes
158
views
asked 7 months agolg...