Questions tagged with Extract Transform & Load Data
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hi, I'm running a data pipeline from legacy DB(oracle) to Redshift using AWS Glue.
I want to test the connection to the legacy DB before executing ETL without test query in working python...
1
answers
0
votes
258
views
asked 10 months agolg...
Can't load the datalg...
Can't load the data from server and what can I do now ?
1
answers
0
votes
174
views
asked a year agolg...
I am trying to create an insert into statement which queries a source table, which has a column containing a STRUCT data-type. This table is automatically created via crawler and the column definition...
1
answers
0
votes
446
views
asked a year agolg...
I've been setting an AWS Glue test environment in which business users should use tables available in Glue catalog as data sources for their Glue jobs. The tables in the catalog come from data marts...
2
answers
0
votes
1138
views
asked a year agolg...
Hello,
I have a Glue Pyspark job that writes to Amazon S3 in a CSV format, I don't see any file with CSV extension on Amazon S3. How can see it ?
I am using `write_dynamic_frame.from_options`...
3
answers
0
votes
254
views
asked a year agolg...
Hi!
I'm having some issue processing a DynamoDB export in Glue. It looks like my schema is breaking DynamicFrame's unnestDDBJson transformation.
This is the minimal test case that will trigger the...
1
answers
0
votes
422
views
asked a year agolg...
Using the step: "Derived Column" where I can use SQL functions to derive new columns I found SUBSTRING works but CHARINDEX it doesn't. And as usual with AWS documentation, there's no place or...
1
answers
0
votes
338
views
asked a year agolg...
Hi there,
I have an AWS Glue Pipeline where I am reading data from an RDS Postgres instance and copying data over into a RedShift warehouse. I have noticed that when using the "MERGE" operation, that...
1
answers
0
votes
710
views
asked a year agolg...
I am new to AWS Glue and I am encountering an issue while trying to use the "google bigquery connector 0.24.2 for aws glue 3.0" in an AWS Glue Job. The goal is to establish a connection between my RDS...
1
answers
0
votes
295
views
asked a year agolg...
py4j.protocol.Py4JJavaError: An error occurred while calling o492.pyWriteDynamicFrame.
: org.apache.spark.SparkException: Job aborted due to stage failure: Task 323 in stage 2.0 failed 4 times, most...
0
answers
0
votes
74
views
asked a year agolg...
HI Exports,
I am new in AWS
I have plane now SharePoint data move in Mysql(RDS0 using ETL tool.
please suggest which tool is best.
Thanks
Shanvitha
0
answers
0
votes
33
views
asked a year agolg...
Hi All,
I was following the steps mentioned at below link to work locally on my system .
https://aws.amazon.com/blogs/big-data/introducing-aws-glue-interactive-sessions-for-jupyter/
This is...
1
answers
0
votes
318
views
asked a year agolg...