Remove yourself and phone users from private chat user list