登入
洞見 - Gradient Descent Optimization
Understanding Gradient Descent Dynamics in Phase Retrieval Landscapes
The authors investigate the behavior of gradient descent in high-dimensional landscapes, revealing a transition from informative to uninformative local curvature during optimization. Successful recovery is achieved before the algorithmic transition at large dimensions.
Global L2 Minimization in Deep Learning Networks
Modified gradient descent methods achieve global L2 cost minimization in overparametrized and underparametrized settings.
Directional Smoothness and Gradient Methods: New Sub-Optimality Bounds
新しい局所最適性の境界を開発する勾配降下法（GD）に関する研究。
