Fix game ending with 1s left on timer

https://bugzilla.gnome.org/show_bug.cgi?id=721722