Shuffled Autoregressive Models: A Novel Approach to Flexible Sequence Generation

By allowing autoregressive models to generate sequences in any order, the proposed σ-GPT approach offers key advantages such as conditional density estimation, infilling, and burst sampling, while maintaining comparable performance to standard left-to-right trained models.