Questions tagged with Extract Transform & Load Data
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hello,
I am experience an issue when trying to use the Glue ETL on one of tables in my data catalogue. I am using the visual tool with a very simple SQL transformation on the table and when clicking...
0
answers
0
votes
86
views
asked 9 months agolg...
I have a large postgres table which is having issues replicating on DMS v3.5.1. The same task (and endpoints) work fine with v3.4.7, so I have rolled back to that for now. The job is a full load &...
1
answers
0
votes
862
views
asked 9 months agolg...
Hello,
I am trying to save job parameters that I would like to pass to individual jobs within the workflow. After adding them and clicking the 'Update' button and reopening the job parameters, all...
1
answers
0
votes
254
views
asked 9 months agolg...
I am looking to have metadata produced by crawlers during Glue Jobs record both source AND target information on the same data catalog table. From the research I have done, recording source metadata...
1
answers
0
votes
228
views
asked 9 months agolg...
In a AWS Glue job, I am getting issue when I am trying to execute sql query in below code:
```
source_dataset = glueContext.create_dynamic_frame.from_options(connection_type="oracle",...
2
answers
0
votes
1970
views
asked 9 months agolg...
Hi,
I have created a JDBC connection (setup VPC, subnet and security group) called 'my_test_connection that connects to an external postgres database. The connection test passed. I was also able crawl...
1
answers
0
votes
468
views
asked 9 months agolg...
I am using glue to move data from s3 and redshift into a data lake. I would like to use a combination of AWS glue and Athena to create a source to target mapping report. The goal is to make the report...
1
answers
0
votes
258
views
asked 9 months agolg...
Hello team,
We are planning to build a data lake in AWS that will contain regularly extracted data from an on-prem data warehouse. The purpose of this data lake is to serve the following purposes in...
2
answers
0
votes
324
views
asked 9 months agolg...
My AWS glue job is configured to extract data from one rds postgres DB and insert it into another one (after some transormations).
Although the job completes "succesfully", I can't see any data i the...
1
answers
0
votes
481
views
asked 9 months agolg...
I would like to adopt Iceberg tables for easier data management in the data lake but we have a dependency on Redshift Spectrum and it seems that Amazon is not planning on supporting Iceberg in...
1
answers
0
votes
387
views
asked 10 months agolg...
Hello, I have a table with a lot of daily sales in QuickSight. I have grouped the table by daily date and created two more columns: daily sales for this year using the formula = sum(ifelse(date =...
1
answers
0
votes
192
views
asked 10 months agolg...
Hi,
**Problem statement:** Currently if we're running a query with multiple temporary tables and want to rerun the whole query without errors, it is necessary to drop the temporary tables. Usually...
1
answers
4
votes
211
views
asked 10 months agolg...