Neural Network Relief: Pruning Algorithm Based on Neural Activity

The authors propose an iterative pruning strategy with an importance-score metric to deactivate unimportant connections in deep neural networks, achieving significant parameter compression while maintaining comparable accuracy. Their approach aims to simplify networks by finding the smallest number of connections necessary for a given task.