Improving Sentence Representations by Integrating Token-Level and Sentence-Level Objectives in Cross-Lingual Encoders

Integrating token-level and sentence-level objectives in cross-lingual sentence encoders significantly improves the quality of sentence representations across various tasks.