Don't allow joining to invite-only channels by users who have never been invited