AdvPrompter: Fast Adaptive Adversarial Prompting for LLMs
Date: 2024-04
Affected: Llama-2, Vicuna, GPT-3.5, GPT-4
Attack vector: jailbreak
Category: research
Severity: High

Paulus et al. train an attacker LLM (AdvPrompter) that emits human-readable adversarial suffixes about 800x faster than GCG. Suffixes are coherent, evade perplexity filters, and transfer to unseen instructions and black-box targets.


Mitigations:

Architectural layers (MAESTRO):