Unsupervised dimensionality reduction methods like PCA can significantly reduce the dimensionality of sentence embeddings without sacrificing performance in downstream tasks.
Pretrained Language Models (PLMs) sentence embeddings can be effectively reduced in dimensionality using unsupervised methods like PCA, improving performance in downstream tasks.