NEPENTHE, an iterative unstructured approach, can effectively reduce the depth of over-parameterized deep neural networks with little to no performance loss.
A method to reduce the depth of deep neural networks by iteratively linearizing the lowest-entropy layer while preserving performance.