Never try to kill the engine if it is already dead

Currently we attempt to kill the engine immediately after we detect it
has stopped.