Unanswered Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hi all,
I've noticed some limitations while using Glue Workflows, that I'd like to suggest or possibly hear if there are alternatives.
1) Suppose you have job C depending on both jobs A and B...
0
answers
0
votes
202
views
asked 8 months agolg...
I have a raw bucket which performs read using glue job and writes to discovery bucket . In this process I’m facing error like not able to process the files present in location raw bucket ( from logs...
0
answers
0
votes
66
views
asked 8 months agolg...
I'm trying to update an existing AWS Glue Crawler for a DocumentDB instance. Given that it won't take a wildcard to add all the collections to the crawler I'm looking for an easy way to add several...
0
answers
0
votes
38
views
asked 8 months agolg...
Hello, we have an S3 bucket with various CSV files and an AWS Glue crawler to update the Data Catalog and finally an AWS Glue job to move the data to RedShift. The handling of data and target table is...
0
answers
0
votes
121
views
asked 8 months agolg...
I've got Athena setup to query a DocumentDB instance with the Lambda function built and AWS Glue configured. The setup was done through the datasource connector for DocumentDB.
I can see the database...
0
answers
0
votes
165
views
asked 8 months agolg...
Hello everyone.
Data from the rest api in the form of JSON is loaded daily by lambda into s3-bucket-1.
Then this data should be stored in s3-bucket-2 in the form of a flat parquet table.
I did it in...
0
answers
0
votes
68
views
asked 9 months agolg...
Hi,
Has anyone manage to make the Delta-Spark python package work with Glue interactive session? It works when I submit Glue 4.0 job but not on interactive session. Below are a few code snippets that...
0
answers
0
votes
45
views
asked 9 months agolg...
Hi Team,
I am using below code and its giving me the columns from the data, but my expectation to get the columns from Glue Data Catalog.
glueContext.create_dynamic_frame.from_catalog(database =...
0
answers
0
votes
83
views
asked 9 months agolg...
Are there any known, recently (~07/18/2023) introduced performance issues with Glue crawlers?
We have recently observed excessive slowness with Glue crawlers that had been running for months without...
0
answers
0
votes
28
views
asked 9 months agolg...
I'm trying to create a Glue Crawler with the default IAM role that Glue creates in the process, but when I click "Create crawler" it shows the error message at the...
0
answers
0
votes
72
views
asked 9 months agolg...
I read data from s3 using as follow.
```
sec_id_dyf = glueContext.create_dynamic_frame.from_options(
connection_type = 's3',
...
0
answers
0
votes
92
views
asked 9 months agolg...
Hello,
I am experience an issue when trying to use the Glue ETL on one of tables in my data catalogue. I am using the visual tool with a very simple SQL transformation on the table and when clicking...
0
answers
0
votes
86
views
asked 9 months agolg...