Universal and Transferable Adversarial Attacks on Aligned Language Models (GCG)
Date: 2023-07
Affected: Vicuna, Llama-2-Chat, GPT-3.5/4, Claude, Bard, Pythia, Falcon
Attack vector: jailbreak
Category: research
Severity: Critical

Zou et al. introduce GCG (Greedy Coordinate Gradient), an optimization-based method that automatically finds adversarial suffixes which, when appended to harmful prompts, jailbreak aligned LLMs. The suffixes optimized against open-source Vicuna transfer to ChatGPT, Bard, Claude, and Llama-2-Chat in the black-box setting.


Mitigations:

Architectural layers (MAESTRO):