Optimizing Effectiveness and Efficiency Trade-offs in Large Language Model-based Re-Ranking through Ranked List Truncation

Ranked list truncation (RLT) can improve the trade-offs between effectiveness and efficiency in large language model-based re-ranking by dynamically trimming the retrieved list on a per-query basis.