Copilot4D: Unsupervised Learning of World Models for Autonomous Driving via Discrete Diffusion

Copilot4D, a novel world modeling approach, tokenizes sensor observations with VQVAE and then predicts the future via discrete diffusion, significantly outperforming prior state-of-the-art methods for point cloud forecasting in autonomous driving.