This paper introduces two new RL algorithms leveraging the Koopman operator, achieving state-of-the-art performance compared to traditional methods.