
Prodigy is an algorithm that improves the convergence rate of D-Adaptation, providing a state-of-the-art solution for learning rate adaptation.


coremsg

prodigy-an-adaptive-learning-rate-algorithm-for-optimization


Prodigy: An Adaptive Learning Rate Algorithm for Optimization



Optimierung des adaptiven Lernraten für Follow-the-Regularized-Leader zur Erreichung optimaler Ergebnisse.



Adaptive Learning Rate for Follow-the-Regularized-Leader: Competitive Ratio Analysis and Best-of-Both-Worlds
