
The author introduces Atrous Attention, a fusion of regional and sparse attention, inspired by atrous convolution, to balance local and global information in vision transformers.


coremsg

acc-vit-atrous-convolution-s-impact-on-vision-transformers


ACC-ViT: Atrous Convolution's Impact on Vision Transformers


title_rewrite


Atrous Attention in ACC-ViT enhances global context and hierarchical relations in vision transformers.


acc-vit-atrous-convolution-s-comeback-in-vision-transformers


ACC-ViT: Atrous Convolution's Comeback in Vision Transformers
