HarmBench: standardized evaluation for automated red-teaming
Date: 2024
Affected: LLM / agent evaluation surface
Attack vector: jailbreak
Category: red-team
Severity: Medium

~400 harmful behaviours (incl. contextual and multimodal) for automated red-teaming and robust-refusal evaluation across 18 attack methods. ICML 2024.


Mitigations:

Architectural layers (MAESTRO):