Dissecting Adversarial Robustness of Multimodal LM Agents

Key findings

• Adversarial text on a single trigger image hijacks agents built on GPT-4o and Claude with up to 67% success - Attack-graph analysis shows captioning components are the weakest link

Sources

• arxiv.orghttps://arxiv.org/abs/2406.12814