Formalizing and Benchmarking Prompt Injection Attacks and Defenses

Key findings

• A formal framework unifies existing attacks; combined attacks are strongest - Evaluated ten LLMs and seven tasks; existing defences are insufficient - Introduces Open-Prompt-Injection benchmark

Sources

• arxiv.orghttps://arxiv.org/abs/2310.12815