EC2 instance kills the long running process, ssh connection closed

0

I'm running a python script which processes large amount of data and takes around 16 hrs to complete. The cpu usage is shown below in the pic. The gap between the two peaks is where, ec2-instance kills the running python script and logs out any ssh connection. The ram memory utilization is also shown below. Any pointers where to look for the problem? ram cpu

Ashwini
asked 8 months ago433 views
1 Answer
2

It is most likely that ssh is timeout, I recommend the following options to launch your scripts in the background

  • You can add your script to cron to be run regularly.
  • You can run your script manually, and detach+background it using nohup.

I hope it can help you, if not, could you add the command you use to run the python script?

profile picture
EXPERT
answered 8 months ago
profile pictureAWS
EXPERT
kentrad
reviewed 8 months ago
  • It kills the python script and multiple running tmux sessions. I don't think it is ssh timeout.

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions