統計資料
최적 학습 과정에서의 속성을 검증하는 실험 결과
LM의 스케일링 법칙 개선에 대한 통계
引述
"Our objective is to minimize the area under loss curve, which is equivalent to maximizing the compression ratio of training corpus in the 'LM-training-as-lossless-compression' view."
"The near-optimal learning policy essentially improves the coefficients in the scaling law of LMs, indicating great promise and significance for designing practical learning acceleration methods."