Unanswered Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I am building a pipeline from ETL to complete ML lifecycle. I have used AWS glue notebooks for most of the ETL Job and I have created pipeline with step functions. Rest Machine learning work completed...
0
answers
0
votes
95
views
asked a year agolg...
We're using the `GlueSchemaRegistryDeserializerDataParser` class from https://github.com/awslabs/aws-glue-schema-registry.
This seems to be from the v1 of the AWS SDK (or am I wrong?)
Is there a...
0
answers
0
votes
94
views
asked a year agolg...
We're using the `GlueSchemaRegistryDeserializerDataParser` class from https://github.com/awslabs/aws-glue-schema-registry.
This seems to be from the v1 of the AWS SDK (or am I wrong?)
Is there a...
0
answers
0
votes
63
views
asked a year agolg...
We use DMS to export data from MY SQL to S3 post which we run ETLs. The Glue ETLs use bookmarks hence reads only what has changed from the last time it ran . However the raw data keeps increasing in...
0
answers
0
votes
66
views
asked a year agolg...
Hi there,
i'm just able to see two out of four columns in athena. I don't know the reason but could it be because of my glue schema version? I tried changing the precicision and scale number but it...
0
answers
0
votes
130
views
asked a year agolg...
I am looking for sample glue streaming script that reads data from kafka and writes into s3 in iceberg format .
I have gone through aws documentation , but did not find enough details to start with...
0
answers
0
votes
116
views
asked a year agolg...
Hello, everyone.
We are experimenting some issues when trying to query some tables in AWS Athena. We have a bucket on S3 which we are feeding some parquets from a gold layer from our data lake. These...
0
answers
0
votes
56
views
asked a year agolg...
I have manually created an lake formation tag key :classification with tag value :non pii and associated to tag to table columns,here i want use glue. Job using detetect pii and custome code (boto 3...
0
answers
0
votes
48
views
asked a year agolg...
I am trying to create standard glue external tables with terraform, replacing a number of lake formation governed tables. The original lake governed tables had no table specific permissions granted...
0
answers
0
votes
91
views
asked a year agolg...
Dear AWS re:Post
For my ETL jobs, I read most of my date from RDS, but some I read directly from a table whose data sit on S3.
I only discovered today that each job run generated not insignificant...
0
answers
0
votes
89
views
asked a year agolg...
using
```
UNLOAD(SELECT * FROM TABLE) TO 's3://...'
WITH (format = 'PARQUET',compression = 'SNAPPY');
```
there is a column in table with is an array which comes back with`Parquet record is...
0
answers
0
votes
77
views
asked a year agolg...
When using https://docs.aws.amazon.com/glue/latest/dg/interactive-sessions.html in my jupyter notebook whenever an exception is raised I do not see any details:
```
def main():
raise...
0
answers
0
votes
65
views
asked 2 years agolg...