Only reboot if there was no boot since we marked the need to reboot