Efficient Fine-Tuning of Large Foundation Models Using Discrete Fourier Transform

The proposed FourierFT method achieves significant parameter reduction for fine-tuning large foundation models by learning sparse spectral coefficients of the weight changes, outperforming state-of-the-art low-rank adaptation methods.