Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Getting error while connecting streaming data from kinesis to redshift with few transformations using visual ETL. (using amazon kinesis - glue data catalog table as source ). Schema is already...
1
answers
0
votes
209
views
asked a month agolg...
I have created a glue trigger using cdk. My question is how can I deactivate this trigger using CDK. Here is my code -
```
const myTrigger = new CfnTrigger(this,`my-trigger-dev`, {
name:...
1
answers
0
votes
180
views
asked a month agolg...
Hello Friends,
I am working on a project that reads data from Dremio data lakehouse solution, I am trying to read the data from one of its schema. Glue does not natively come with the connector, so I...
2
answers
0
votes
173
views
asked a month agolg...
We have a Redshift Cluster with DC2 nodes and a Redshift Serveless service running on same AWS account in us-east-1 region.
When trying to query the SVV_EXTERNAL_TABLE view on the Redshift cluster, we...
2
answers
0
votes
229
views
asked 2 months agolg...
Hello, first sorry for my English
We are facing an issue that, returns a time out using the method GetWorkflowRuns boto3, because we have a lot of runs in history
And I'm not finding anything to...
Accepted AnswerAWS Glue
1
answers
0
votes
211
views
asked 2 months agolg...
Actually i uploaded one JSON file into my s3 bucket which is having nested JSON data. and, created Athena table out of it by using glue crawler. after that when i was trying to query the table i am...
0
answers
0
votes
345
views
asked 2 months agolg...
I have an AWS Glue job that transfers data from a PostgreSQL database to Amazon S3. The job functioned efficiently until the size of the data increased. Now, when attempting to save approximately 2-3...
1
answers
0
votes
191
views
asked 2 months agolg...
0
I'm encountering a NoSuchKey error while attempting to create an Athena Iceberg table using AWS Wrangler. Here's the anonymized error message:
{
"errorMessage": "GENERIC_INTERNAL_ERROR:...
0
answers
0
votes
245
views
asked 2 months agolg...
Hello,
I have an AWS Glue job that is only supposed to perform an SQL query on the current status. Unfortunately, I always get the following error: "Error Category: QUERY_ERROR; AnalysisException:...
1
answers
0
votes
282
views
asked 2 months agolg...
Question:
We currently have approximately 100 tables in delta format, partitioned by yyyy, mm, dd, hh, mm. Our current process involves reading these delta tables via a crawler, cataloging them, and...
0
answers
0
votes
362
views
asked 2 months agolg...
Reading few gb say 15gb of parquet skewed data , after few transformation such as data type change for some columns and then doing repartitions (dataframe.repartition(120)) before writing it to s3 in...
1
answers
0
votes
296
views
asked 2 months agolg...
While trying to visualize the Glue Workflow detail page I get the following error:
```
There was an issue processing your request.
Error: ChunkLoadError: Loading chunk 7 failed. (error:...
1
answers
0
votes
188
views
asked 2 months agolg...