He told the estimated 65 attendees to leave shortly thereafter, the lawsuit says.