Questions tagged with Extract Transform & Load Data
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
The goal is to create an ETL job that can be altered and executed by non-technical users in our organization, which is why we are sticking to only visuals and not code.
The problem is that the nodes...
1
answers
0
votes
877
views
asked a year agolg...
Hi,
I'm loading a set of files from S3 and filtering the dataset to files from the last hour.
See error in the Cloudwatch log below:
```
Processing parameterized path with the following...
0
answers
0
votes
113
views
asked a year agolg...
I'm attempting to write some ETL jobs in a jupyter notebook, however whenever I leave the page the notebook isn't listed on my written jobs. When I attempt to save the notebook manually I get this...
1
answers
0
votes
453
views
asked a year agolg...
Hi Folks,
I have a table called demo and it is cataloged in Glue. The table has three partition columns (col_year, col_month and col_day). I want to get the name of the partition columns...
1
answers
0
votes
561
views
asked a year agolg...
Hi AWS, I have a folder inside s3 bucket where the cost and usage report data is stored both in .csv and .csv.gz format. When I am creating the TABLE using that LOCATION the records are not printed in...
1
answers
0
votes
697
views
asked a year agolg...
Hi,
I've try to import some table, from Saas Instance of Sap SuccessFactors to S3.
At the moment I've exposed from SAP SuccessFactors API and I consume it to a custom Lambda (that write the data into...
1
answers
1
votes
667
views
asked a year agolg...
Hi,
I'm writing an ETL that before inserting data into S3 needs to clean up the staging area, the staging area also is connected as a data catalog table. Ideally the ETL should:
1- clean S3 folder...
1
answers
1
votes
462
views
asked a year agolg...
Hi,
I am using Glue studio editor to write some ETL with target S3. In the configuration I checked the flag *Create a table in the Data Catalog and on subsequent runs, update the schema and add new...
1
answers
0
votes
602
views
asked a year agolg...
Hello,
I'm using a glue studio to do some custom transformation that I have in csv files and it's basically having a scheme as I'm sending here. ![Glue...
1
answers
0
votes
533
views
asked a year agolg...
I added PCA to my flow, I chose the numeric values, added a value for components and clicked preview. This error pops up: OperatorCustomerError: Py4JJavaError: breeze.linalg.NotConvergedException:
I...
0
answers
0
votes
70
views
asked a year agolg...
I work for a company that generates large amounts of business and sensor data and stores it in different databases (Prometheus, InfluxDB, Postgres, Timestream). Currently the querying for analytics...
2
answers
0
votes
413
views
asked a year agolg...
I am following the steps outlined in the link below:
https://aws.amazon.com/blogs/big-data/introducing-native-delta-lake-table-support-with-aws-glue-crawlers/
(1) No issue with Query Delta Lake...
1
answers
0
votes
450
views
asked a year agolg...