Improved Few-Shot Jailbreaking Circumvents Aligned LLMs and Defenses
Date: 2024-06
Affected: Llama-2-7B-Chat, GPT-3.5, defended LLMs
Attack vector: jailbreak
Category: research
Severity: High

Zheng et al. show that just eight curated few-shot examples can jailbreak Llama-2-7B-Chat and GPT-3.5 with near-100 percent success, even against perplexity, SmoothLLM, and self-reminder defenses.


Mitigations:

Architectural layers (MAESTRO):