JailbreakBench: open robustness benchmark for LLM jailbreaking
Date: 2024
Affected: LLM / agent evaluation surface
Attack vector: jailbreak
Category: red-team
Severity: Medium

JBB-Behaviors: 100 misuse behaviours across 10 OpenAI-policy categories (harassment, malware, physical/economic harm, fraud, disinformation, sexual content, privacy, expert/government advice) plus an evolving set of jailbreak artifacts. NeurIPS 2024 Datasets & Benchmarks.


Mitigations:

Architectural layers (MAESTRO):