PRP: Propagating Universal Perturbations to Attack LLM Guardrails
Date: 2024-02
Affected: LlamaGuard, NeMo Guardrails, guarded LLM pipelines
Attack vector: jailbreak
Category: research
Severity: High

Mangaokar et al. craft universal suffixes that propagate through guardrail models (LlamaGuard, NeMo Guardrails) so that downstream LLM outputs are classified safe even when harmful.


Mitigations:

Architectural layers (MAESTRO):