Mixture-of-PEFTs: A Framework for Efficient Fine-Tuning of the Segment Anything Model

A new framework, Mixture-of-PEFTs (MoPEFT), that incorporates different Parameter-Efficient Fine-Tuning (PEFT) methods as submodules and dynamically learns to activate the fine-tuning method(s) that best suit the data or task of interest, achieving better performance than individual PEFT methods across multiple domains.