Can Language Models Learn Semantics Through Next-Word Prediction? Investigating Entailment Relations
The authors investigate the ability of language models to predict entailment relations through next-word prediction, finding that LMs implicitly model aspects of semantics to predict semantic effects on sentence co-occurrence patterns.