Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks
Date: 2024-04
Affected: GPT-3.5, GPT-4, Claude, Llama-2/3, Gemma, Mistral, Phi-3
Attack vector: jailbreak
Category: research
Severity: Critical

Andriushchenko, Croce, and Flammarion show that a combination of prompt templates, random search, and self-transfer yields 100 percent ASR on Vicuna-13B, Mistral-7B, Phi-3, Nemotron-4-340B, Llama-2-7B, Llama-3-8B, Gemma-7B, GPT-3.5, GPT-4, and Claude variants.


Mitigations:

Architectural layers (MAESTRO):