Books3 dataset of pirated books used to train Llama and Bloom
Date: 2023-08
Affected: Authors / downstream LLM operators
Attack vector: model-poisoning
Category: real-world
Severity: Medium

Books3, a 196,640-book corpus largely drawn from the pirate library Bibliotik, was used to train Meta's LLaMA, EleutherAI's GPT-J/Neo, and Bloom; subsequent legal actions targeted the propagation of pirated copyrighted material through foundation models.


Mitigations:

Architectural layers (MAESTRO):