STEER-BENCH: A Benchmark for Evaluating the Steerability of Large Language Models
Year: 2025

Steerability, or the ability of large language models (LLMs) to adapt outputs to align with diverse community-specific norms, perspectives, and communication styles, is critical for real-world applications but remains underevaluated.We introduce STEER-BENCH, a benchmark for assessing population-specific steering using contrasting Reddit communities.Covering 30 contrasting subreddit pairs across 19 domains, STEER-BENCH includes over 10,000 instruction-response pairs and validated 5,500 multiple-c