InjecAgent: Benchmarking Indirect Prompt Injection in Tool-Integrated LLM Agents
Date: 2024-03
Affected: 30 LLM agents including GPT-4, Claude, Llama
Attack vector: prompt-injection
Category: research
Severity: High

Zhan et al. release InjecAgent, with 1,054 test cases spanning 17 user tools and 62 attacker tools. ReAct-prompted GPT-4 is vulnerable 24 percent of the time, doubling under reinforced attack prompts. Findings of ACL 2024.


Mitigations:

Architectural layers (MAESTRO):