Prevent the preemption timer to run when termination is requested

* The call to cancel() might not work if it was about to expire.