Fix lobby scoreboard staying ingame when server lags a little bit