Questions tagged with Extract Transform & Load Data
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hi all,
I have followed the instructions https://docs.aws.amazon.com/athena/latest/ug/connect-data-source-serverless-app-repo.html to deploy Timestream as an additional data source to Athena and can...
1
answers
0
votes
350
views
asked a year agolg...
I've created a data validation box in my Glue ETL, which imports the following:
`from awsgluedq.transforms import EvaluateDataQuality`
To develop further my script, I've copied the script to a AWS...
2
answers
0
votes
564
views
asked a year agolg...
Here is my code snippet:
[transaction_DyF = glueContext.create_dynamic_frame.from_catalog(
database = source_db,
table_name =...
1
answers
0
votes
405
views
asked a year agolg...
When a DMS Data Migration Tasks is configured as Full-Load and connected to a target endpoint of type S3 bucket, for a few tables there are some phantom files being added when the task runs. The files...
2
answers
0
votes
272
views
asked a year agolg...
I have creating glue job that is reading parquet file from s3 and using iceberg connector to create iceberg table . I have used catalog name as my_catalog , database I have created with name db and...
1
answers
1
votes
4152
views
asked a year agolg...
I'm writing into redshift and realized Glue 4.0 is probably optimizing the column sizes.
Summary of error:
```
py4j.protocol.Py4JJavaError: An error occurred while calling...
3
answers
0
votes
1014
views
asked a year agolg...
Hi,
I retrieve data each hour from an API. Data are statistical informations about cities. Until today I was storing the data as parquet in a S3 bucket with two partition : the day and the hour....
0
answers
0
votes
56
views
asked a year agolg...
Hello,
There are similar questions on the forum and most recommendations are to override the data type but I wanted to give context on what I'm trying to achieve in case there's a better solution.
I...
1
answers
0
votes
270
views
asked a year agolg...
Greetings,
I am trying to read JSON data in an AWS Bucket using Python.
I don't get any errors, but don't return any data in Python script??
Any suggestions to resolve this. would be...
2
answers
0
votes
335
views
asked a year agolg...
We use DMS to export data from MY SQL to S3 post which we run ETLs. The Glue ETLs use bookmarks hence reads only what has changed from the last time it ran . However the raw data keeps increasing in...
0
answers
0
votes
66
views
asked a year agolg...
where clause doesn't work in sql transform in glue. any help is appreciated.
1
answers
0
votes
551
views
asked a year agolg...
Hello,
By default Glue run one executor per worker. I want to run more executors in worker. I have set following spark configuration in Glue params but It didn't work.
`--conf :...
1
answers
0
votes
2107
views
asked a year agolg...