Research question
Are deep networks stable to small, imperceptible input perturbations?
Key findings
- Imperceptible perturbations found by optimisation flip classifications reliably - The same perturbations transfer across models trained on different data - Individual units are no more semantically meaningful than random directions in activation space
