Regularized Adaptive Momentum Dual Averaging Algorithm for Training Structured Neural Networks

RAMDA is the first regularized adaptive method outputting models with outstanding predictive performance while being optimally structured.