Questions tagged with Extract Transform & Load Data
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hi all,
I can able to append my data to curated. But I can't able to overwrite. During **overwrite** curated existing file was deleted but not write a new file.
***My script:***
df....
1
answers
0
votes
894
views
asked a year agolg...
My job succeeds with no error but when I query the table, its empty
The CSV is a single column with no header
The table has a single column, record_id
```
SELECT TOP 1000 [record_id]
FROM
...
2
answers
0
votes
390
views
asked a year agolg...
Dear AWS Communities,
I would like to transfer my 32TB of csv.gz files from S3 Standard out to internet.
However, the cost is gigantic for an individual like me.
I am wondering is there any way to...
1
answers
0
votes
274
views
asked a year agolg...
Hi, i need a tool that can be implemented easely to control the lineage between external sources like SnowFlake and AWS(Glue,lambda etc), thanks for your help
1
answers
0
votes
603
views
asked a year agolg...
Hi,
I have 32TB of data stored on S3 Standard bucket and would like to make a copy to my on-premise SQL Server (local machine) via SQL Server Integration Services (SSIS).
(1) I am wondering does it...
2
answers
0
votes
495
views
asked a year agolg...
Hi, i have ran a crawler that connects by jdbc to SnowFlake and it creates a table into the Glue catalog database, that works nice.
now i want to use glue studio to take the source (AWS Glue Data...
2
answers
0
votes
462
views
asked a year agolg...
I am trying to migrate 3 tables and my selection rule looks like this and I get an error
where schema name is like 'EEOP_INTEG' and Source table name is like '[EEOP_USER, EEOP_ORG, EEOP_USER_ORG]',...
2
answers
0
votes
516
views
asked a year agolg...
When I am trying to upload a regular data table from the query, it is not being uploaded to Quicksight. The Full Refresh is giving also problems. When I run the query on the Hubble, it works...
1
answers
0
votes
292
views
asked a year agolg...
Hello everybody,
I'm working for a small retail company, where we want to move our data to aws. Our data can be from different sources (postgresDB, MySQL DB or other unstructured data sources or...
2
answers
0
votes
340
views
asked a year agolg...
Issue importing custom Python modules in Jupyter notebooks with SparkMagic and AWS Glue endpointlg...
I'm encountering an issue while attempting to run ETL scripts in Jupyter notebooks using SparkMagic, which is connected to an AWS Glue endpoint via SSH. I followed the tutorial provided in the AWS...
2
answers
0
votes
726
views
asked a year agolg...
I am trying to create a **Custom Visual transform** but unfortunately facing some issues.
Here my motive it to truncate a **MySQL** table before loading the data into it and I want to do it with the...
1
answers
0
votes
284
views
asked a year agolg...
Hi, I am using G2x type worker, during data write operation glue job allocating only 5 executors and not allocating more executors which makes process getting so long. How to resolve this issue.
3
answers
0
votes
506
views
asked a year agolg...