Questions tagged with Extract Transform & Load Data
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I am using AWS Sagemaker data wrangler to transform my data. When data is completely transformed and exported the data to amazon s3 the data exported is in parts not a complete single file how to...
1
answers
1
votes
306
views
asked a year agolg...
I want to overwrite or truncate a table in Mysql using aws glue job python, I tried using preactions like redshift but It doesn't work.
here is my code :
```
datasink4 =...
1
answers
0
votes
2033
views
asked a year agolg...
I'm evaluating Lake Formation and facing abysmally slow table reading numbers. For example, both `wr.lakeformation.read_sql_table` and `wr.athena.read_sql_table` need 50-60 sec to read a small...
1
answers
0
votes
291
views
asked a year agolg...
Hi all,
My concern is I need to flatten the json file . When i am using glue visual studio it's flatten top level. I need to flatten deep.
1
answers
0
votes
468
views
asked a year agolg...
Hi all,
I can able to append my data to curated. But I can't able to overwrite. During **overwrite** curated existing file was deleted but not write a new file.
***My script:***
df....
1
answers
0
votes
852
views
asked a year agolg...
My job succeeds with no error but when I query the table, its empty
The CSV is a single column with no header
The table has a single column, record_id
```
SELECT TOP 1000 [record_id]
FROM
...
2
answers
0
votes
371
views
asked a year agolg...
Dear AWS Communities,
I would like to transfer my 32TB of csv.gz files from S3 Standard out to internet.
However, the cost is gigantic for an individual like me.
I am wondering is there any way to...
1
answers
0
votes
265
views
asked a year agolg...
Hi, i need a tool that can be implemented easely to control the lineage between external sources like SnowFlake and AWS(Glue,lambda etc), thanks for your help
1
answers
0
votes
588
views
asked a year agolg...
Hi,
I have 32TB of data stored on S3 Standard bucket and would like to make a copy to my on-premise SQL Server (local machine) via SQL Server Integration Services (SSIS).
(1) I am wondering does it...
2
answers
0
votes
479
views
asked a year agolg...
Hi, i have ran a crawler that connects by jdbc to SnowFlake and it creates a table into the Glue catalog database, that works nice.
now i want to use glue studio to take the source (AWS Glue Data...
2
answers
0
votes
452
views
asked a year agolg...
I am trying to migrate 3 tables and my selection rule looks like this and I get an error
where schema name is like 'EEOP_INTEG' and Source table name is like '[EEOP_USER, EEOP_ORG, EEOP_USER_ORG]',...
2
answers
0
votes
486
views
asked a year agolg...
When I am trying to upload a regular data table from the query, it is not being uploaded to Quicksight. The Full Refresh is giving also problems. When I run the query on the Hubble, it works...
1
answers
0
votes
279
views
asked a year agolg...