PoisonGPT: Mithril Security demonstrates LLM supply-chain disinfo via Hugging Face typosquat
Date: 2023-07-01
Affected: Hugging Face ecosystem
Attack vector: supply-chain
Category: real-world
Severity: Critical

Mithril Security modified an open-source GPT-J variant to surgically alter factual outputs (e.g., claiming Yuri Gagarin was first on the moon) and uploaded it to a typosquatted Hugging Face repo 'EleuterAI' (vs. 'EleutherAI'). Downloaded 40+ times before takedown. Demonstrated AI supply-chain risk.


Mitigations:

Architectural layers (MAESTRO):