PrivAgent / LeakAgent: RL-based Red-teaming for LLM Privacy Leakage
Date: 2024-12
Affected: GPT-4, Claude, Gemini, Llama, Mistral, Qwen
Attack vector: membership-inference
Category: research
Severity: High

Nie et al. train an RL-driven attack agent to generate adversarial prompts that extract system prompts and training data from six frontier LLMs, outperforming prior automated privacy attacks.


Mitigations:

Architectural layers (MAESTRO):