Unanswered Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
We're using the `GlueSchemaRegistryDeserializerDataParser` class from https://github.com/awslabs/aws-glue-schema-registry.
This seems to be from the v1 of the AWS SDK (or am I wrong?)
Is there a...
0
answers
0
votes
93
views
asked a year agolg...
We're using the `GlueSchemaRegistryDeserializerDataParser` class from https://github.com/awslabs/aws-glue-schema-registry.
This seems to be from the v1 of the AWS SDK (or am I wrong?)
Is there a...
0
answers
0
votes
62
views
asked a year agolg...
We use DMS to export data from MY SQL to S3 post which we run ETLs. The Glue ETLs use bookmarks hence reads only what has changed from the last time it ran . However the raw data keeps increasing in...
0
answers
0
votes
66
views
asked a year agolg...
Hi there,
i'm just able to see two out of four columns in athena. I don't know the reason but could it be because of my glue schema version? I tried changing the precicision and scale number but it...
0
answers
0
votes
130
views
asked a year agolg...
I am looking for sample glue streaming script that reads data from kafka and writes into s3 in iceberg format .
I have gone through aws documentation , but did not find enough details to start with...
0
answers
0
votes
116
views
asked a year agolg...
Hello, everyone.
We are experimenting some issues when trying to query some tables in AWS Athena. We have a bucket on S3 which we are feeding some parquets from a gold layer from our data lake. These...
0
answers
0
votes
56
views
asked a year agolg...
I have manually created an lake formation tag key :classification with tag value :non pii and associated to tag to table columns,here i want use glue. Job using detetect pii and custome code (boto 3...
0
answers
0
votes
47
views
asked a year agolg...
I am trying to create standard glue external tables with terraform, replacing a number of lake formation governed tables. The original lake governed tables had no table specific permissions granted...
0
answers
0
votes
90
views
asked a year agolg...
Dear AWS re:Post
For my ETL jobs, I read most of my date from RDS, but some I read directly from a table whose data sit on S3.
I only discovered today that each job run generated not insignificant...
0
answers
0
votes
89
views
asked a year agolg...
using
```
UNLOAD(SELECT * FROM TABLE) TO 's3://...'
WITH (format = 'PARQUET',compression = 'SNAPPY');
```
there is a column in table with is an array which comes back with`Parquet record is...
0
answers
0
votes
77
views
asked a year agolg...
When using https://docs.aws.amazon.com/glue/latest/dg/interactive-sessions.html in my jupyter notebook whenever an exception is raised I do not see any details:
```
def main():
raise...
0
answers
0
votes
64
views
asked 2 years agolg...
I am trying to modify a PySpark/Glue job to write a DynamicFrame to a new table in Glue Catalog, with a Parquet format.
The database exists, the table does not yet. I am following the instructions...
0
answers
0
votes
140
views
asked 2 years agolg...