CloudWatch stopping tail when file is deleted

Question

I am trying to monitor a log file on an EC2 instance that is deleted and re-added every morning. I have CloudWatch agent monitoring the path but as soon as the file is deleted, the tail stops and when the file is added again with the same name, the log is not pushed to CloudWatch.   
  
When I restart the agent and check the status I get this:  
  
May 07 08:31:29  start-amazon-cloudwatch-agent /\[ 31209 /] : 2020/05/07 08:31:29 Stopping tail as file no longer exists:   
  
Any thoughts?  
  
Edited by: niamh on May 7, 2020 2:36 AM  
  
Edited by: niamh on May 7, 2020 2:36 AM

Answer

the cloudwatch agent checkpoints via file handles, not the name of the file.  
  
You should use something like logrotate to rotate the file, not just delete it.  By doing so, Cloudwatch will be able to continuously monitor the file.

CloudWatch stopping tail when file is deleted

Relevant content