Generating Realistic Lidar Point Clouds with Transformers and Diffusion Models

LidarGRIT, a novel generative model, uses auto-regressive transformers to iteratively sample range images in the latent space and a VQ-VAE to separately decode range images and raydrop masks, achieving superior performance compared to state-of-the-art models on KITTI-360 and KITTI odometry datasets.