Analyzing Heavy-Tail Properties of Stochastic Gradient Descent with Stochastic Recurrence Equations

Heavy-tail properties of SGD analyzed through stochastic recurrence equations reveal significant insights.