Unified Batch Normalization: Addressing Feature Condensation in Neural Networks
In this work, the authors propose Unified Batch Normalization (UBN) to address feature condensation in Batch Normalization (BN). By introducing a two-stage framework, UBN significantly enhances performance and training efficiency by rectifying normalization components and mitigating feature condensation.