Achieving High-Accuracy Global Weather Forecasting with Transformer-Based Models and Efficient Training Strategies
Transformer-based models can achieve superior forecast skill compared to traditional physics-based numerical weather prediction models, even with relatively simple training procedures and moderate compute budgets.