Remove old channels and actually fix join/part