Scaling Trends for Data Poisoning in LLMs
Date: 2024-08
Affected: Llama, Pythia, OPT, instruction-tuned LLMs
Attack vector: model-poisoning
Category: research
Severity: High

Bowen et al. empirically map how much data needs to be poisoned to bias LLM behavior across different model sizes, showing low percentage requirements and persistence through safety tuning.


Mitigations:

Architectural layers (MAESTRO):