Large-Scale Self-Supervised Pre-Training of an Acoustic Music Understanding Model (MERT)

A novel self-supervised learning paradigm, MERT, that incorporates acoustic and musical teacher models to pre-train a generalisable and computationally affordable acoustic music understanding model, achieving state-of-the-art performance on a wide range of music information retrieval tasks.