Questions tagged with Extract Transform & Load Data
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I am using glue to move data from s3 and redshift into a data lake. I would like to use a combination of AWS glue and Athena to create a source to target mapping report. The goal is to make the report...
1
answers
0
votes
266
views
asked 10 months agolg...
Hello team,
We are planning to build a data lake in AWS that will contain regularly extracted data from an on-prem data warehouse. The purpose of this data lake is to serve the following purposes in...
2
answers
0
votes
346
views
asked 10 months agolg...
My AWS glue job is configured to extract data from one rds postgres DB and insert it into another one (after some transormations).
Although the job completes "succesfully", I can't see any data i the...
1
answers
0
votes
499
views
asked 10 months agolg...
I would like to adopt Iceberg tables for easier data management in the data lake but we have a dependency on Redshift Spectrum and it seems that Amazon is not planning on supporting Iceberg in...
1
answers
0
votes
404
views
asked 10 months agolg...
Hello, I have a table with a lot of daily sales in QuickSight. I have grouped the table by daily date and created two more columns: daily sales for this year using the formula = sum(ifelse(date =...
1
answers
0
votes
199
views
asked 10 months agolg...
Hi,
**Problem statement:** Currently if we're running a query with multiple temporary tables and want to rerun the whole query without errors, it is necessary to drop the temporary tables. Usually...
1
answers
4
votes
218
views
asked 10 months agolg...
I'm using aws glue's visual etl builder to extract data from one rds postgres DB, transform it, then insert it into another rds postgres db (similar business entities but different schema).
The...
2
answers
0
votes
1026
views
asked 10 months agolg...
What are the pros and cons when it comes to using **AWS Glue** over Redshift's internal functions (such as **COPY** and **INSERT**)? for bulk data loading (In terms of **cost, time, and...
1
answers
0
votes
351
views
asked 10 months agolg...
I'm building a glue job for a data migration with schema changes and mappings between two RDS postgres DBs.
I'm getting an error connecting to glue apis.
```
AnalysisException:...
1
answers
0
votes
277
views
asked 10 months agolg...
Trying to write to my OpenSearch cluster
"An error occurred while calling o265.pyWriteDynamicFrame. Connection error (check network and/or proxy settings)- all nodes failed; tried...
1
answers
0
votes
400
views
asked 10 months agolg...
using aws for data visualization using custom python scripts and the best database for the usecase.lg...
I am sending data into kinesis data streams and thinking of using firehose to send data into Redshift, i want to use this database to run custom Python scrips to visualize data.
1
answers
0
votes
305
views
asked 10 months agolg...
Hi everyone, I was trying to ingest csv data to Timestream Db with AWS SDK boto3.M y credential , region , Database_Name, Table_Name are all correct but still I am unable to connect to endpoint of my...
0
answers
0
votes
78
views
asked 10 months agolg...