Can Large Language Models Achieve Instruction-Data Separation?

Large language models lack proper instruction-data separation, leading to potential vulnerabilities and malfunctions. The author proposes a formal measure to quantify this separation and introduces a dataset for evaluation.