Intermittent Packet loss at AWS Singapore EC2 instance using MTR tool

1

hi,

I have an EC2 instance suffering intermittent packet loss seconds to hours when accessed by 2 different telcos at a particular location. No issue if access from another location. I have attached the 2 way MTR results which shows high packet loss in AWS network. Kindly help to advice. FYI, i have enabled ICMP ping for all sources at the EC2 instance and the telco router for testing purpose.

![Enter image description here

Enter image description here

Best Regards, Thum Ching Kuan

  • Hi, it's hard to help without more details on the exact configuration: do you use those 2 telcos with https://aws.amazon.com/directconnect/ or do you access this EC2 instance over Internet ? In second case, are those 2 telcos serving your corporate locations to access Internet? Do you have BGP routing in place ? Adding to your text an image describing your config in more details would really help.

  • I am doing the MTR between the EC2 instance with AWS elastic IP and the telcos's router with dynamic public IP on site. No direct connect.

ckthum
asked 10 months ago334 views
2 Answers
0

The internet is a big place and packet loss happens because....the internet is a big place. We (AWS) don't have control over the networks that make up the internet. That's made even more difficult because the routing and network landscape can change on a second-by-second basis.

That said: Because we are interested in trying to help when our customers are having a bad experience we do try - even in cases where we can't influence things directly. Here, the best thing to do is to raise a ticket with the support team so that we can try and diagnose which providers might be an issue (or even if there is an issue on our network).

Edit after seeing a comment on the original question: Don't do ping/traceroute to a router (especially one you don't control) as it will most likely be unreliable especially if the router is under load. A router's job is to forward packets and it is highly optimised to do that. Sending an ICMP packet (echo request) to the router forces it to use a different code path; create a reply packet; queue that packet; then send it back to you. Most (admittedly, not all) router vendors do not optimise their network stack on the router for this. Under load (even minor load) a router is probably going to drop many ICMP packets. Administrators can also configure their router not to respond to repeated echo requests from a specific source.

I can't say whether this is what is happening here but you're much better off testing against a host that you control. You're also better off not using ICMP but instead creating a TCP session and transferring data between two hosts - it's a much better way of determining packet loss.

profile pictureAWS
EXPERT
answered 10 months ago
  • Does that mean that we need to subscribe technical support and pay for it ?

  • Yes, that's correct.

0

I have subscribed to technical support. How do I contact the technical personnel to look into this issue ? I have done the reachability and accessibility analysis under network manager and nothing found. Thanks.

Thum
answered 8 months ago
  • In the AWS console at the top right there is a question mark with a circle around it - click that to go to the support page.

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions