Remove players from internal map immediately.
Should resolve #117