End the game only when the time is less than zero