Tensor Trust: Prompt Injection Attacks from an Online Game
Date: 2023-11
Affected: GPT-3.5, GPT-4, Claude, deployed LLM apps
Attack vector: prompt-injection
Category: research
Severity: Medium

Toyer et al. release a dataset of 126,000 attacks and 46,000 defenses crowdsourced from the Tensor Trust prompt-injection game. They benchmark prompt extraction and prompt hijacking; many strategies transfer to real LLM apps. ICLR 2024.


Mitigations:

Architectural layers (MAESTRO):