MasterKey: Automated Jailbreak Across Multiple LLM Chatbots
Date: 2023-07
Affected: GPT-3.5, GPT-4, Bing Chat, Bard
Attack vector: jailbreak
Category: research
Severity: High

Deng et al. use time-based analysis (inspired by SQL injection) to reverse-engineer commercial chatbot defenses, then train an LLM to auto-generate jailbreaks. MasterKey reaches 21.58 percent ASR vs 7.33 percent for prior methods on GPT-3.5/4, Bing Chat, and Bard.


Mitigations:

Architectural layers (MAESTRO):