Questions tagged with Extract Transform & Load Data
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hello,
I am experience an issue when trying to use the Glue ETL on one of tables in my data catalogue. I am using the visual tool with a very simple SQL transformation on the table and when clicking...
0
answers
0
votes
92
views
asked 10 months agolg...
I have a large postgres table which is having issues replicating on DMS v3.5.1. The same task (and endpoints) work fine with v3.4.7, so I have rolled back to that for now. The job is a full load &...
1
answers
0
votes
926
views
asked 10 months agolg...
Hello,
I am trying to save job parameters that I would like to pass to individual jobs within the workflow. After adding them and clicking the 'Update' button and reopening the job parameters, all...
1
answers
0
votes
282
views
asked 10 months agolg...
I am looking to have metadata produced by crawlers during Glue Jobs record both source AND target information on the same data catalog table. From the research I have done, recording source metadata...
1
answers
0
votes
241
views
asked 10 months agolg...
In a AWS Glue job, I am getting issue when I am trying to execute sql query in below code:
```
source_dataset = glueContext.create_dynamic_frame.from_options(connection_type="oracle",...
2
answers
0
votes
2135
views
asked 10 months agolg...
Hi,
I have created a JDBC connection (setup VPC, subnet and security group) called 'my_test_connection that connects to an external postgres database. The connection test passed. I was also able crawl...
1
answers
0
votes
514
views
asked 10 months agolg...
I am using glue to move data from s3 and redshift into a data lake. I would like to use a combination of AWS glue and Athena to create a source to target mapping report. The goal is to make the report...
1
answers
0
votes
272
views
asked 10 months agolg...
Hello team,
We are planning to build a data lake in AWS that will contain regularly extracted data from an on-prem data warehouse. The purpose of this data lake is to serve the following purposes in...
2
answers
0
votes
358
views
asked 10 months agolg...
My AWS glue job is configured to extract data from one rds postgres DB and insert it into another one (after some transormations).
Although the job completes "succesfully", I can't see any data i the...
1
answers
0
votes
523
views
asked 10 months agolg...
I would like to adopt Iceberg tables for easier data management in the data lake but we have a dependency on Redshift Spectrum and it seems that Amazon is not planning on supporting Iceberg in...
1
answers
0
votes
415
views
asked 10 months agolg...
Hello, I have a table with a lot of daily sales in QuickSight. I have grouped the table by daily date and created two more columns: daily sales for this year using the formula = sum(ifelse(date =...
1
answers
0
votes
206
views
asked 10 months agolg...
Hi,
**Problem statement:** Currently if we're running a query with multiple temporary tables and want to rerun the whole query without errors, it is necessary to drop the temporary tables. Usually...
1
answers
4
votes
224
views
asked 10 months agolg...