Correctly remove players on disconnect