Fixes to players sticking around:
* If a player has left without going on a server, this no longer causes a reference to stay around
* Players leaving after disconnecting from a server (an exceptional case) no longer causes issues