Knowledge Base Regulation Tracker Standards & Frameworks OSS Directory AI Incident Database Research Paper Library Case Studies Society Articles News Jobs About Charter Sign inBecome a Member

AgentDojo

The standard benchmark for prompt-injection attacks and defences on tool-using agents, used to evaluate CaMeL, FIDES and most subsequent defences.

agentdojobenchmarkagents

Research question

How should the security of tool-using agents be evaluated dynamically?

Key findings

  • 97 realistic tasks and 629 security test cases across email, banking, travel and Slack environments - Best agents solved under 66% of tasks; injection attacks succeed on under 25% but defences trade utility

Sources

Contribute

Spot an error, or know a record we should add? Members can propose additions and submit corrections.