RTSP Stream Dropping Packets in EC2

0

We have an inference pipeline reading an RTSP stream (GStreamer based) and performing inference (object detection/tracking). When we run our pipeline on our local server we have no issues and the system works as expected, however, when we move to deploy on AWS we suffer severe packet loss. Running tcpdump during testing on our local server we may recieve 1,000 warnings out of 300,000 packets, whereas on AWS EC2 (g4dn.xlarge) we recieve 100,000 warnings out of 300,000 packets. I analysed the traces in WireShark and on our server we see a repeating IO graph (60kb/s to 500kb/s) with minimal tcp errors, on AWS we see a repeating IO graph (60kb/s -> 700kb/s) with several tcp errors. To give a bit more insight we also measure camera read time to be about 1ms or less on our local server, on AWS we see ranges from 20ms to 120ms for camera read time.

Does anyone have any tips/things we can try to figure out what's going on?

Thanks!

ConnorM
asked 2 years ago377 views
1 Answer
1
Accepted Answer

This sort of performance problem is really difficult to troubleshoot at this distance. I'd strongly recommend raising a support case - the support team have visibility into what is happening in and around your instance and will be able to help.

profile pictureAWS
EXPERT
answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions