Questions tagged with Extract Transform & Load Data
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hi!
I'm having some issue processing a DynamoDB export in Glue. It looks like my schema is breaking DynamicFrame's unnestDDBJson transformation.
This is the minimal test case that will trigger the...
1
answers
0
votes
443
views
asked a year agolg...
Using the step: "Derived Column" where I can use SQL functions to derive new columns I found SUBSTRING works but CHARINDEX it doesn't. And as usual with AWS documentation, there's no place or...
1
answers
0
votes
367
views
asked a year agolg...
Hi there,
I have an AWS Glue Pipeline where I am reading data from an RDS Postgres instance and copying data over into a RedShift warehouse. I have noticed that when using the "MERGE" operation, that...
1
answers
0
votes
755
views
asked a year agolg...
I am new to AWS Glue and I am encountering an issue while trying to use the "google bigquery connector 0.24.2 for aws glue 3.0" in an AWS Glue Job. The goal is to establish a connection between my RDS...
1
answers
0
votes
309
views
asked a year agolg...
py4j.protocol.Py4JJavaError: An error occurred while calling o492.pyWriteDynamicFrame.
: org.apache.spark.SparkException: Job aborted due to stage failure: Task 323 in stage 2.0 failed 4 times, most...
0
answers
0
votes
75
views
asked a year agolg...
HI Exports,
I am new in AWS
I have plane now SharePoint data move in Mysql(RDS0 using ETL tool.
please suggest which tool is best.
Thanks
Shanvitha
0
answers
0
votes
34
views
asked a year agolg...
Hi All,
I was following the steps mentioned at below link to work locally on my system .
https://aws.amazon.com/blogs/big-data/introducing-aws-glue-interactive-sessions-for-jupyter/
This is...
1
answers
0
votes
359
views
asked a year agolg...
I have created a replication task with Postgres as source and S3 as destination and I have noticed that it cannot replicate columns created after the start of the task.
After the changes in the source...
2
answers
0
votes
1513
views
asked a year agolg...
Hi Folks, i have a glue job in a step function that is taking so long to continue to the next step, i monitor the job by glue studio and it finish well, but after 40 or 45 secs after the job has...
1
answers
0
votes
958
views
asked a year agolg...
I have 2 streams and I am using analytics Zeppelin notebook to merge the 2 streams but in the future, i will be using more streams I want to know if it's possible to scale everything so it...
0
answers
0
votes
68
views
asked a year agolg...
Hi! I have two tables with the same columns but in different order.
Let's say **Table 1**:
| ID | Customer| Date |
| - | ------------ | ------------- |
| 1 | John |...
1
answers
0
votes
200
views
asked a year agolg...
What is the maximum number of Databases and maximum Number of tables within a given database that can be created in AWS Glue? We're planning a large scale simulation application that will enable users...
1
answers
0
votes
847
views
asked a year agolg...