gpt-4o-mini AgentHarm evaluation (Inspect Evals)
Date: 2025
Affected: OpenAI gpt-4o-mini
Attack vector: jailbreak
Category: research
Severity: Medium

Evaluation of OpenAI gpt-4o-mini-2024-07-18 on the AgentHarm benchmark via Inspect Evals, measuring harmful-task compliance of an agentic system.


Mitigations:

Architectural layers (MAESTRO):