A Probabilistic Approach to Reinforce Sparse Gradients in Batch Optimization
A probabilistic framework to identify and amplify sparse gradients within large mini-batches, improving the diversity of updates and driving the optimization deeper towards the global minimum.
