When failing because of retry exhaustion, ensure we leave a group, message