Leveraging Modular Pre-trained Graphformer for Efficient Web-scale Learning to Rank

The proposed MPGraf model leverages a modular and pre-trained graphformer architecture to cohesively integrate the regression capabilities of Transformers with the link prediction strengths of Graph Neural Networks (GNNs) for efficient web-scale learning to rank.