RAMDA is the first regularized adaptive method outputting models with outstanding predictive performance while being optimally structured.