Neuron sharing is encouraged in weight decay regularized neural networks, promoting multi-task learning and efficient feature learning.