A StrongREJECT for Empty Jailbreaks

Key findings

• Many "successful" jailbreaks produce vague or useless responses - StrongREJECT scores harmfulness and quality, aligning better with human judgements; jailbreaks degrade capability

Sources

• arxiv.orghttps://arxiv.org/abs/2402.10260