Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Models

Key findings

• BIPIA benchmark across email, web, table and code tasks; all 25 models tested were vulnerable - Boundary awareness and explicit reminders reduce attack success; adversarial training reduces it to near zero at some capability cost

Sources

• arxiv.orghttps://arxiv.org/abs/2312.14197