only call skeleton#removeClient if it has a skeleton