Evaluating API Gateway for internal microservices communication

0

IHAC implemented an API Gateway with private integration to provide unified entry and access control for services in their Kubernetes cluster. Use case is mostly for service-to-service communication, specific requirements such as access control, runtime validation, unified entry.

Functionally this works, but performance tests show noticeable latency - a simple service-ingress-service test took 3s while the API Gateway took 11s. The architecture seems sound, so I'm wondering if this huge extra latency is normal with API Gateway, if others have seen this, or if there may be a misconfiguration.I understand latency will be added, but the question is more if too much is normal. Any insights on if this performance impact is expected or can be improved would be greatly appreciated. I'm also considering alternatives like VPC Lattice in integration with EKS, but I don’t want to discard the current option.

References used so far: https://docs.aws.amazon.com/apigateway/latest/developerguide/getting-started-with-private-integration.html https://aws.amazon.com/blogs/containers/application-networking-with-amazon-vpc-lattice-and-amazon-eks/

2개 답변
1
수락된 답변

While some additional latency is expected with an API Gateway, an increase from 3s to 11s for a simple service-ingress-service test is indeed significant and warrants investigation.

Here are some potential reasons for the high latency and possible solutions: 1/ Check the API Gateway configuration for enabled plugins and authentication/authorization mechanisms. These can add processing overhead, especially for complex configurations.

2/ Explore caching . Caching frequently accessed responses can significantly reduce latency for subsequent requests.

3/ Network Latency: Analyze the network path between the API Gateway and the backend service. Look for bottlenecks or high latency hops that might be contributing to the overall delay.

4/ Investigate resource utilization within the Kubernetes cluster. If other pods or services are competing for resources, it can impact the performance

I would suggest to make use of logging ,tracking and metrics using cloudwatch to nail down the issue. Try to figure out which hop takes most time. Usually Api Gateway shouldn't add more than few millisec latency.

profile pictureAWS
cloudyy
답변함 2달 전
1

API Gateway adds a few 10s of ms, not 8 seconds. I recommend that you enable execution logs on API Gateway and check what is going on there. In addition, you can enable X-Ray which will do end to end tracing of your transactions.

profile pictureAWS
전문가
Uri
답변함 2달 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인