Questions tagged with Extract Transform & Load Data
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hi Folks,
I have a table called demo and it is cataloged in Glue. The table has three partition columns (col_year, col_month and col_day). I want to get the name of the partition columns...
1
answers
0
votes
516
views
asked a year agolg...
Hi AWS, I have a folder inside s3 bucket where the cost and usage report data is stored both in .csv and .csv.gz format. When I am creating the TABLE using that LOCATION the records are not printed in...
1
answers
0
votes
642
views
asked a year agolg...
Hi,
I've try to import some table, from Saas Instance of Sap SuccessFactors to S3.
At the moment I've exposed from SAP SuccessFactors API and I consume it to a custom Lambda (that write the data into...
1
answers
1
votes
625
views
asked a year agolg...
Hi,
I'm writing an ETL that before inserting data into S3 needs to clean up the staging area, the staging area also is connected as a data catalog table. Ideally the ETL should:
1- clean S3 folder...
1
answers
1
votes
443
views
asked a year agolg...
Hi,
I am using Glue studio editor to write some ETL with target S3. In the configuration I checked the flag *Create a table in the Data Catalog and on subsequent runs, update the schema and add new...
1
answers
0
votes
586
views
asked a year agolg...
Hello,
I'm using a glue studio to do some custom transformation that I have in csv files and it's basically having a scheme as I'm sending here. ![Glue...
1
answers
0
votes
484
views
asked a year agolg...
I added PCA to my flow, I chose the numeric values, added a value for components and clicked preview. This error pops up: OperatorCustomerError: Py4JJavaError: breeze.linalg.NotConvergedException:
I...
0
answers
0
votes
65
views
asked a year agolg...
I work for a company that generates large amounts of business and sensor data and stores it in different databases (Prometheus, InfluxDB, Postgres, Timestream). Currently the querying for analytics...
2
answers
0
votes
383
views
asked a year agolg...
I am following the steps outlined in the link below:
https://aws.amazon.com/blogs/big-data/introducing-native-delta-lake-table-support-with-aws-glue-crawlers/
(1) No issue with Query Delta Lake...
1
answers
0
votes
420
views
asked a year agolg...
I try to use Glue Crawler to read CSV files from S3 and create catalog table from it. Crawler run succesfully and it will create catalog table but those tables are empty (without columns) if I have...
3
answers
0
votes
1003
views
asked a year agolg...
When I started an etl job and mapped one table to a s3 bucket and change some data type. I got two columns empty because these two columns included some null value, how can I skip the null value in...
0
answers
0
votes
60
views
asked a year agolg...
I converted a CSV(from S3) to parquet(to S3) using AWS glue and the file which is converted to Parquet was named randomly .How do i choose the name of the file that is to be converted to Parquet from...
1
answers
0
votes
774
views
asked a year agolg...