DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Training

DPOT introduces a novel auto-regressive denoising pre-training strategy and scalable model architecture based on Fourier attention for large-scale PDE pre-training, achieving state-of-the-art results on diverse downstream tasks.