Core Concepts
Embeddings in contrastive learning tend to merge into a singular point, affecting accuracy. Orthonormal Anchor Regression Loss mitigates this issue.
Stats
"Our method demonstrates remarkable improvements with just a fraction of the conventional label requirements."
Quotes
"A too-large learning rate causes a significant drop in accuracy."