Add notice for leaving a group