Balancing Contextual and Parametric Knowledge in Large Language Models: An Adaptive Decoding Approach
ADACAD, a dynamic decoding method, effectively balances the use of contextual and parametric knowledge in large language models to improve performance on knowledge-intensive tasks, especially when there is variable conflict between the two knowledge sources.