Measuring Sycophancy of Language Models in Multi-turn Dialogues
Year: 2025

Large Language Models (LLMs) are expected to provide helpful and harmless responses, yet they often exhibit sycophancy-conforming to user beliefs regardless of factual accuracy or ethical soundness.Prior research on sycophancy has primarily focused on single-turn factual correctness, overlooking the dynamics of real-world interactions.In this work, we introduce SYCON BENCH, a novel benchmark for evaluating sycophantic behavior in multiturn, free-form conversational settings.Our benchmark measure