LORS: Low-rank Residual Structure for Parameter-Efficient Network Stacking

LORS introduces a low-rank residual structure to reduce parameters in stacked structures while maintaining or improving model performance.