AWS announces preview of AWS Interconnect - multicloud

AWS announces AWS Interconnect – multicloud (preview), providing simple, resilient, high-speed private connections to other cloud service providers. AWS Interconnect - multicloud is easy to configure and provides high-speed, resilient connectivity with dedicated bandwidth, enabling customers to interconnect AWS networking services such as AWS Transit Gateway, AWS Cloud WAN, and Amazon VPC to other cloud service providers with ease.

copy 2TB data from s3 to redshift take more than 2 days is hung

the data set is 2 Tera Bytes with 30Billow rows and 80 columns for 20 years history. our redshift cluster is 2 ra3.4xlarge I have successfully loaded 5 years (1/4) of the data set in 6 hours any advice?

Topics: Analytics
Tags: Amazon Redshift
Language: English

Winston

asked 2 years ago281 views

1 Answer

Newest
Most votes
Most comments

Are these answers helpful? Upvote the correct answer to help the community benefit from your knowledge.

Accepted Answer

just talked to AWS Support, they advised to load by chunk by chunk, not all the data in one big load.

Winston

answered 2 years ago

Relevant content

Redshift COPY commend takes the wrong file from S3
cxcxcx
asked 3 years ago
import tables with large data columns from redshift federated schema into local tables
vida
asked 3 years ago
Is it safe to delete the original files from Amazon S3 after using the COPY command to import the data into an Amazon Redshift table?
Accepted Answer
Lucas
asked 2 years ago
How is data returned from Spectrum to Redshift cluster?
Accepted Answer
Jay_M
asked 6 years ago
How do I troubleshoot issues when I copy data from Amazon S3 into Amazon Redshift?
AWS OFFICIALUpdated 8 months ago
How do I copy or unload data from Amazon Redshift to an Amazon S3 bucket that's in another account?
AWS OFFICIALUpdated a year ago
How do I calculate Amazon Redshift Spectrum query charges?
AWS OFFICIALUpdated 9 months ago
How do I use the SUPER data type in Amazon Redshift to handle and query JSON data?
AWS OFFICIALUpdated 8 months ago
Cross account IAM permission set-up for running a Redshift COPY Command from Amazon S3 bucket in one AWS account to Amazon Redshift in another AWS account.
EXPERT
Washim Nawaz
published a year ago
Amazon Redshift Cost Optimization best practices
EXPERT
Nita_S
published 6 months ago

copy 2TB data from s3 to redshift take more than 2 days is hung

Add your answer

Relevant content