Don't remove channel unless all users have parted. + test