LoRA Fine-tuning Efficiently Undoes Safety Training in Llama 2-Chat 70B

Key findings

• Under $200 of LoRA compute reduced refusal rates to about 1% on Llama 2-Chat 70B - Capabilities were preserved, so open-weight safety training offers little protection

Sources

• arxiv.orghttps://arxiv.org/abs/2310.20624