Auto-regressive large language models (LLMs) trained on sentences of the form "A is B" fail to generalize to the reverse direction "B is A".
