Parameter Efficient Multi-task Model Fusion with Partial Linearization

The author proposes a novel partial linearization method to enhance multi-task fusion for parameter-efficient fine-tuning techniques. By partially linearizing only the adapter modules, the approach leverages model fusion advantages while maintaining efficiency in fine-tuning and inference.