Skip to content

URGENT! Lightsail instance immediately crashes when reaches burstable zone without using up burst allowance.

0

It's happening everyday now in recent weeks that as soon as the CPU hits above the sustainable zone my server immediately crashers and stops responding. I want to understand the Remaining CPU burst capacity as it seems it's a useless feature because it does not provide allowance when the CPU goes in the burstable zone.

See attached image where it goes over the burstable zone and burst capacity is still 100% but during this time, the server is not responding at all and I had to stop and start the server for it to come back!

Please can you provide some explanation?

Enter image description here

asked a year ago257 views

4 Answers
0

For context, I have a lightsail ubuntu instance with 2 GB RAM and 2 vCPUs. I use it as my dev server and it doesn't have any cron running in the background when I am away or anything else that runs on schedule apart from the daily automatic snapshots. This means that if I am not using it, it's suppose to be idle.

I have installed sysstat yesterday and enabled it as well before I logged off my server. Here's a screenshot of what's happening with the CPU from 9pm last night when I am completely logged off and not doing anything on the server. Unless the sysstat is so resource heavy, I do not have a clue what's keeping it busy during this graveyard times.

Enter image description here

answered a year ago

  • Can you post the output of sar and sar -r for that period? What dev software do you have installed?

  • What time zone are you in?

    On the positive side, it does not appear to be crashing when hitting burstable zone and credit usage matches the CPU usage in the burstable zone.

    Try running pidstat to see what processes have tallied CPU time.

0

As commented in other post, I suspect your CPU usage is a symptom and not the cause of your issues. Crashing immediately or becoming unresponsive is more likely caused by memory than CPU. I would recommend that you setup sysstat in the OS to see how memory is tracking before the issue occurs.

If you truly believe you need support to find the source of the issue, it would be wise to open a support case to have AWS look at your instance from the backend and help find cause.

AWS
EXPERT

answered a year ago

0

Hi, Thanks for your help so far. Please find below the output of sar for that period and screenshots of CPU peak times. The server is just LAMP webserver.

As you can see it did not log anything on 25th Nov because the server has crashed by then.

Enter image description here

Enter image description here

answered 10 months ago

0

Enter image description here

Definitely memory issue.

Notice on the left the timestamps for logging deviate from the 10 minute cadence, indication that the system was unresponsive for a period of time. Next notice that during those same periods, you see %commit jump from 96% to 150%. You were running very close to capacity and then committed an additional 54%. During that time, it evicted items that were cached in memory to use for committed and finally you'll notice that kbavail drops to 588kb. At that time the instance becomes unresponsive till you likely rebooted it at 10:53:53.

As previously suggested, your CPU usage is a symptom of a thrashing system, not the cause. Jump to the next instance size to increase memory and I bet your problems will vanish.

Alternatively, stop some of the services that you are running to reduce required memory or add some swap space. The swap space may allow you to get by without becoming unresponsive but performance would be less than optimal. With the commit jumping 54%, I think swap will not likely meet your needs.

AWS
EXPERT

answered 10 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.