Jailbreaking GPT-4V via Self-Adversarial Attacks with System Prompts (SASP)
Date: 2023-11
Affected: GPT-4V
Attack vector: jailbreak
Category: research
Severity: High

Wu et al. show that GPT-4V leaks its system prompt and that GPT-4 can be used as a red-teamer to craft jailbreak prompts against itself based on the leaked system prompt, achieving high success on GPT-4V.


Mitigations:

Architectural layers (MAESTRO):