Instructions as Backdoors

Key findings

• Poisoning about 1,000 instructions achieves over 90% attack success without touching inputs or labels - Backdoors transfer to many held-out tasks and resist continual fine-tuning

Sources

• arxiv.orghttps://arxiv.org/abs/2305.14710