The Art of Saying No: Contextual Noncompliance in Language Models
Authors: name: Faeze Brahman; name: Sachin Kumar; name: Vidhisha Balachandran; name: Pradeep Dasigi; name: Valentina Pyatkin; name: Abhilasha Ravichander; name: Sarah Wiegreffe; name: Nouha Dziri; name: Khyathi Chandu; name: Jack Hessel; name: Yulia Tsvetkov; name: Noah A. Smith; name: Yejin Choi; name: Hannaneh Hajishirzi
Published: 2024-07-02 07:12:51

Abstract: Chat-based language models are designed to be helpful, yet they should not
comply with every user request. While most existing work primarily focuses on
refusal of "unsafe" queries, we posit that the scope of noncompliance should be
broadened. We introduce a comprehensive taxonomy of contextual noncompliance
describing when and how models should not comply with user requests. Our
taxonomy spans a wide range of categories including incomplete, unsupported,
indeterminate, and humanizing requests (in addition to unsafe requests). To
test noncompliance capabilities of language models, we use this taxonomy to
develop a new evaluation suite of 1000 noncompliance prompts. We find that most
existing models show significantly high compliance rates in certain previously
understudied categories with models like GPT-4 incorrectly complying with as
many as 30% of requests. To address these gaps, we explore different training
strategies using a synthetically-generated training set of requests and
expected noncompliant responses. Our experiments demonstrate that while direct
finetuning of instruction-tuned models can lead to both over-refusal and a
decline in general capabilities, using parameter efficient methods like low
rank adapters helps to strike a good balance between appropriate noncompliance
and other capabilities.