Questions tagged with Extract Transform & Load Data
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hi Folks, i have a glue job in a step function that is taking so long to continue to the next step, i monitor the job by glue studio and it finish well, but after 40 or 45 secs after the job has...
1
answers
0
votes
961
views
asked a year agolg...
I have 2 streams and I am using analytics Zeppelin notebook to merge the 2 streams but in the future, i will be using more streams I want to know if it's possible to scale everything so it...
0
answers
0
votes
68
views
asked a year agolg...
Hi! I have two tables with the same columns but in different order.
Let's say **Table 1**:
| ID | Customer| Date |
| - | ------------ | ------------- |
| 1 | John |...
1
answers
0
votes
200
views
asked a year agolg...
What is the maximum number of Databases and maximum Number of tables within a given database that can be created in AWS Glue? We're planning a large scale simulation application that will enable users...
1
answers
0
votes
856
views
asked a year agolg...
I am using AWS Sagemaker data wrangler to transform my data. When data is completely transformed and exported the data to amazon s3 the data exported is in parts not a complete single file how to...
1
answers
1
votes
308
views
asked a year agolg...
I want to overwrite or truncate a table in Mysql using aws glue job python, I tried using preactions like redshift but It doesn't work.
here is my code :
```
datasink4 =...
1
answers
0
votes
2048
views
asked a year agolg...
I'm evaluating Lake Formation and facing abysmally slow table reading numbers. For example, both `wr.lakeformation.read_sql_table` and `wr.athena.read_sql_table` need 50-60 sec to read a small...
1
answers
0
votes
292
views
asked a year agolg...
Hi all,
My concern is I need to flatten the json file . When i am using glue visual studio it's flatten top level. I need to flatten deep.
1
answers
0
votes
473
views
asked a year agolg...
Hi all,
I can able to append my data to curated. But I can't able to overwrite. During **overwrite** curated existing file was deleted but not write a new file.
***My script:***
df....
1
answers
0
votes
859
views
asked a year agolg...
My job succeeds with no error but when I query the table, its empty
The CSV is a single column with no header
The table has a single column, record_id
```
SELECT TOP 1000 [record_id]
FROM
...
2
answers
0
votes
372
views
asked a year agolg...
Dear AWS Communities,
I would like to transfer my 32TB of csv.gz files from S3 Standard out to internet.
However, the cost is gigantic for an individual like me.
I am wondering is there any way to...
1
answers
0
votes
267
views
asked a year agolg...
Hi, i need a tool that can be implemented easely to control the lineage between external sources like SnowFlake and AWS(Glue,lambda etc), thanks for your help
1
answers
0
votes
588
views
asked a year agolg...