Comprehensive Catalog of Transformer Models: Architectures, Pretraining Tasks, and Applications
This paper provides a comprehensive catalog and classification of the most popular Transformer models, along with an introduction to the key aspects and innovations in Transformer architectures.