Glue Job - how to read from jdbc redshift tables in parallel?

0

In the aws documnet

https://docs.aws.amazon.com/glue/latest/dg/run-jdbc-parallel-read-job.html In reading from jdbc tables in parallel it's properties are ignored at redshift.

therfore, how to read from jdbc redshift tables in parallel? Is there anyone who knows?

Topics

Analytics Database

Tags

AWS Glue Extract Transform & Load Data Amazon Redshift

Language

English

AWS-User-5187120

asked 2 years ago453 views

1 Answer

Newest
Most votes
Most comments

Are these answers helpful? Upvote the correct answer to help the community benefit from your knowledge.

0

Using DynamicFrames will utilize COPY/UNLOAD behind the scenes which are executed in parallel.

https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-redshift.html

answered 2 years ago

Relevant content

AWS Glue Job Redshift : Issue Reading Timestamp with timezone from Redshift in AWS Glue Jobs
AWS-User-6422649
asked 2 years ago
How do you read from a postgres table (or other system via JDBC) using Glue and Spark?
Jaime
asked a year ago
Parallelize writing to Iceberg tables in Glue
ThomasMueller
asked 7 months ago
Unable to use Glue Data catalog tables crawled from Snowflake JDBC
EduardoAlves_DE
asked 10 months ago
How do I optimize my AWS Glue ETL workloads when reading from or writing to Amazon DynamoDB?
AWS OFFICIALUpdated 3 years ago
How do I run SQL commands on an Amazon Redshift table before or after writing data in an AWS Glue job?
AWS OFFICIALUpdated a year ago
Why does my AWS Glue job fail with lost nodes when I migrate a large data set from Amazon RDS to Amazon S3?
AWS OFFICIALUpdated 2 years ago
How can I set up a cross-account AWS Glue job for JDBC resources?
AWS OFFICIALUpdated a year ago
AWS Glue Dynamic Frame – JDBC Performance Tuning Configuration
EXPERT
AWSRB
published a year ago
Amazon Redshift adds compression support in the ODBC and JDBC drivers
EXPERT
Raza
published 11 days ago