Efficient Biomedical Text Retrieval with Scalable Large Language Models

BMRETRIEVER, a series of dense retrievers, achieves efficient scaling and strong domain adaptation capabilities for biomedical text retrieval by leveraging unsupervised contrastive pre-training on large biomedical corpora and instruction fine-tuning on diverse labeled datasets, including synthetic examples generated by large language models.