Unanswered Questions tagged with Extract Transform & Load Data
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hello, I am trying to use Glue to take an input file, do my required transformations, then output the columns in a specific order. I also want to output columns that may not be present in the input...
0
answers
0
votes
62
views
asked 2 years agolg...
I have a parameterized glue job , that will be called in parallel (25 glue job) through step functions, when bookmark enabled , version mismatch exception is thrown, when disabled, it runs fine.
....
0
answers
0
votes
146
views
asked 2 years agolg...
I have a glue job that write to a Data Catalog. In the Data Catalog I originally set it up as CSV, and all works fine. Now I would like to try to use Parquet for the Data Catalog. I thought I would...
0
answers
0
votes
128
views
asked 2 years agolg...
I have a Glue ETL job which creates partitions during the job
```
additionalOptions = {"enableUpdateCatalog": True, "updateBehavior": "LOG"}
additionalOptions["partitionKeys"] = ["year",...
0
answers
0
votes
110
views
asked 2 years agolg...
When developing some Glue scripts from a successful Crawler run from a JDBC Oracle data source, I am encountering an error that I cannot resolve.
```
An error occurred while calling...
0
answers
0
votes
126
views
asked 2 years agolg...
I created a Data Catalog with a table that I manually defined.
I run my ETL job and all works well.
I added partitions to both the table in the Data Catalog, as well as the ETL job. it creates the...
0
answers
0
votes
266
views
asked 2 years agolg...
Hi! I am doing a longitudinal study and am trying to prevent previous workers from taking the second part of my survey. In order to do this, I have been following instructions on the MTurk blog...
0
answers
0
votes
75
views
asked 2 years agolg...
I have a Kinesis data Stream whose records I want to insert it in the AWS redshift with using AWS Glue.I created crawlers to bring source table and target table .They are working fine with .
The code...
0
answers
0
votes
123
views
asked 2 years agolg...
I have a S3 bucket with folders in which we have files. I want to make a database to be able to query these documents on a few keys with an API based on Lambda. But for that I need to normalize the...
0
answers
0
votes
79
views
asked 2 years agolg...
A crawler reported it created a table but the table is not visible in the Glue console under tables.
* I can see the table in Athena and when I query it data is returned as expected
* When I use the...
0
answers
1
votes
95
views
asked 2 years agolg...
I have DynamoDB, do ETL to S3 in AWS Glue.
What I did:
1. I have added 6 tables to a job and then in Athene executed query for each table
select * from t;
they work fine.
2. Then I have added 7th...
0
answers
0
votes
70
views
asked 2 years agolg...
With reference to https://forums.aws.amazon.com/thread.jspa?messageID=972484 (and its relocation to...
0
answers
0
votes
88
views
asked 2 years agolg...