GPTFUZZER: Red Teaming LLMs with Auto-Generated Jailbreak Prompts
Date: 2023-09
Affected: ChatGPT, Llama-2, Bard, Claude-2, PaLM2
Attack vector: jailbreak
Category: research
Severity: High

Yu et al. adapt AFL fuzzing to LLM jailbreaks. GPTFuzzer mutates human-written templates and evolves them, achieving >90 percent ASR on ChatGPT and Llama-2 and high transfer rates against Bard (61%), Claude-2 (91%), and PaLM2 (96%).


Mitigations:

Architectural layers (MAESTRO):