AgentHarm: Benchmark for Measuring Harmfulness of LLM Agents
Date: 2024-10
Affected: GPT-4o, GPT-4o-mini, Claude, Mistral Large 2, Gemini
Attack vector: jailbreak
Category: research
Severity: Critical

Andriushchenko et al. (Gray Swan / UK AISI) release AgentHarm with 110 malicious agent tasks across 11 harm categories. Frontier models comply with many tasks even without jailbreaks; a universal template raises GPT-4o harm score from 48.4 to 72.7 percent. ICLR 2025.


Mitigations:

Architectural layers (MAESTRO):