1 Answer
- Newest
- Most votes
- Most comments
1
Have you considered setting up an S3 Gateway endpoint (https://docs.aws.amazon.com/vpc/latest/privatelink/vpc-endpoints-s3.html) or a private link endpoint (https://docs.aws.amazon.com/AmazonS3/latest/userguide/privatelink-interface-endpoints.html) to optimize the networking? Gateway endpoints are no cost where private link has a cost.
answered 3 years ago
Relevant content
- asked 7 months ago
- asked 3 years ago
Thanks for the response! I have not set those up yet, but that was something that I was looking at. Would I have to create a separate endpoint for each instance in my cluster?
Nope! You would set it up to have one gateway or endpoint for the entire VPC.
Just set up the gateway endpoint yesterday, and I saw a very minimal speed increase (basically nonexistent); I will double check all of the setup steps to make sure something wasn't missed. Is there anything else I could try? I will be shocked if GCP is truly faster from S3 than an EC2 cluster.