Reducing Parameters in Stacked Structures with LORS
The author introduces the Low-rank Residual Structure (LORS) to reduce parameters in stacked structures while maintaining performance. Extensive experiments validate the effectiveness of LORS in achieving superior model performance with a significant reduction in parameters.