Questions tagged with Extract Transform & Load Data
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
What is the maximum number of Databases and maximum Number of tables within a given database that can be created in AWS Glue? We're planning a large scale simulation application that will enable users...
1
answers
0
votes
851
views
asked a year agolg...
I am using AWS Sagemaker data wrangler to transform my data. When data is completely transformed and exported the data to amazon s3 the data exported is in parts not a complete single file how to...
1
answers
1
votes
308
views
asked a year agolg...
I want to overwrite or truncate a table in Mysql using aws glue job python, I tried using preactions like redshift but It doesn't work.
here is my code :
```
datasink4 =...
1
answers
0
votes
2040
views
asked a year agolg...
I'm evaluating Lake Formation and facing abysmally slow table reading numbers. For example, both `wr.lakeformation.read_sql_table` and `wr.athena.read_sql_table` need 50-60 sec to read a small...
1
answers
0
votes
291
views
asked a year agolg...
Hi all,
My concern is I need to flatten the json file . When i am using glue visual studio it's flatten top level. I need to flatten deep.
1
answers
0
votes
472
views
asked a year agolg...
Hi all,
I can able to append my data to curated. But I can't able to overwrite. During **overwrite** curated existing file was deleted but not write a new file.
***My script:***
df....
1
answers
0
votes
857
views
asked a year agolg...
My job succeeds with no error but when I query the table, its empty
The CSV is a single column with no header
The table has a single column, record_id
```
SELECT TOP 1000 [record_id]
FROM
...
2
answers
0
votes
372
views
asked a year agolg...
Dear AWS Communities,
I would like to transfer my 32TB of csv.gz files from S3 Standard out to internet.
However, the cost is gigantic for an individual like me.
I am wondering is there any way to...
1
answers
0
votes
266
views
asked a year agolg...
Hi, i need a tool that can be implemented easely to control the lineage between external sources like SnowFlake and AWS(Glue,lambda etc), thanks for your help
1
answers
0
votes
588
views
asked a year agolg...
Hi,
I have 32TB of data stored on S3 Standard bucket and would like to make a copy to my on-premise SQL Server (local machine) via SQL Server Integration Services (SSIS).
(1) I am wondering does it...
2
answers
0
votes
482
views
asked a year agolg...
Hi, i have ran a crawler that connects by jdbc to SnowFlake and it creates a table into the Glue catalog database, that works nice.
now i want to use glue studio to take the source (AWS Glue Data...
2
answers
0
votes
453
views
asked a year agolg...
I am trying to migrate 3 tables and my selection rule looks like this and I get an error
where schema name is like 'EEOP_INTEG' and Source table name is like '[EEOP_USER, EEOP_ORG, EEOP_USER_ORG]',...
2
answers
0
votes
489
views
asked a year agolg...