Integrating large language models with offline reinforcement learning can enable agents to acquire novel skills by generating diverse and meaningful imaginary rollouts that reflect unprecedented optimal behaviors.
