DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Training

The author introduces DPOT, a novel auto-regressive denoising pre-training strategy based on Fourier attention for large-scale PDE pre-training. This approach aims to enhance performance on downstream tasks by leveraging diverse PDE datasets.