properly clean users from channels when connection finishes