Alapfogalmak
FlyKD enables unlimited pseudo label generation with Curriculum Learning for improved optimization over noisy labels.
Statisztikák
"Empirically, we observe that FlyKD outperforms vanilla KD and the renown Local Structure Preserving Graph Convolutional Network (LSPGCN)."
"We show that by storing the probability scores on the links of newly generated random graph per epoch, we can generate 100-1000x or more pseudo labels beyond the threshold of the traditional KD methods."
Idézetek
"Generating tremendous amount of pseudo labels comes at a cost: the pseudo labels are extra noisy."