Rotate the last_log
last_log -> last_log.1 -> last_log.2 -> ... last_log.$max
Overwrite any existing last_log.$max