Efficient Bi-level and Multi-level Projection Methods for Structured Sparsity in Neural Networks

The paper proposes new bi-level and multi-level projection methods that can efficiently enforce structured sparsity in neural networks, with exponential parallel speedup.