Deep ensembles exhibit emergent equivariance through data augmentation, as proven by neural tangent kernel theory.
This paper introduces Lie Algebra Canonicalization (LieLAC), a novel method for achieving equivariance in pre-trained neural networks by transforming inputs to a canonical form, leveraging Lie group theory to enhance performance in image classification and PDE solving tasks.