StrongREJECT: high-quality jailbreak evaluation benchmark
Date: 2024
Affected: LLM / agent evaluation surface
Attack vector: jailbreak
Category: red-team
Severity: Medium

Forbidden-prompt set plus an autograder that measures how useful a jailbroken response actually is, correcting over-estimation by prior jailbreak metrics. NeurIPS 2024.


Mitigations:

Architectural layers (MAESTRO):