
Modern language models tend to generate correct facts initially, but then systematically drift away from the topic and generate incorrect facts later in the text. This "semantic drift" can be measured and mitigated through early stopping and reranking methods to improve the factual accuracy of generated text.


coremsg

semantic-drift-in-text-generation-measuring-and-mitigating-the-decline-in-factual-accuracy


Semantic Drift in Text Generation: Measuring and Mitigating the Decline in Factual Accuracy


title_rewrite


Integrating the value model from Proximal Policy Optimization (PPO) with Monte-Carlo Tree Search (MCTS) decoding can significantly improve the preferability of generated text compared to direct decoding from the PPO policy alone.


leveraging-ppo-value-models-for-improved-text-generation-with-value-guided-monte-carlo-tree-search


Leveraging PPO Value Models for Improved Text Generation with Value-Guided Monte-Carlo Tree Search
