Decomposing the Contributions of In-Context Learning: Label Space, Format, and Discrimination

The performance improvement brought by in-context learning (ICL) can be decomposed into three factors: label space regulation, label format regulation, and discrimination power. ICL exhibits significant efficacy in regulating the label space and format, but has limited impact on improving the model's discriminative capability.