サインイン
インサイト - Contrastive Learning Dynamics
Analyzing Wide Contrastive Models with Neural Tangent Kernels and PCA
Contrastive models trained under cosine similarity losses exhibit nearly constant NTK, while dot product similarity losses lead to drastic changes in NTK.
Wide Contrastive Models: NTK and PCA Analysis
Contrastive models' relation to NTK and PCA analyzed.
