Knowledge Base Regulation Tracker Standards & Frameworks OSS Directory AI Incident Database Research Paper Library Case Studies Society Articles News Jobs About Charter Sign inBecome a Member
Home/Research Paper Library/Not What You've Signed Up For

Not What You've Signed Up For

Defined indirect prompt injection and demonstrated it against Bing Chat, establishing the threat model that dominates LLM application security.

indirect prompt injectionfoundationalbing chat

Research question

Can attackers control LLM applications without direct access, through data the model retrieves?

Key findings

  • Instructions hidden in web pages, emails and documents hijack Bing Chat and GPT-4 apps - Taxonomy of impacts: data theft, fraud, manipulation, worming and availability attacks - Demonstrated end-to-end against real products

Sources

Contribute

Spot an error, or know a record we should add? Members can propose additions and submit corrections.