核心概念
FlyKD enables unlimited pseudo label generation with Curriculum Learning for improved optimization over noisy labels.
統計資料
"Empirically, we observe that FlyKD outperforms vanilla KD and the renown Local Structure Preserving Graph Convolutional Network (LSPGCN)."
"We show that by storing the probability scores on the links of newly generated random graph per epoch, we can generate 100-1000x or more pseudo labels beyond the threshold of the traditional KD methods."
引述
"Generating tremendous amount of pseudo labels comes at a cost: the pseudo labels are extra noisy."