Avoid leaving a shutdown.sh file around when not necessary