Remove remote users on disconnect