Research question
Is there a measurable notion of instruction-data separation in LLMs?
Key findings
- Proposes a formal separation measure and the SEP dataset - Current models, including GPT-4, show weak separation that does not improve with capability
