Efficient Gauss-Newton Approach for Training Generative Adversarial Networks
A novel first-order method based on the Gauss-Newton approach is proposed to efficiently solve the min-max optimization problem in training generative adversarial networks (GANs). The method uses a fixed-point iteration with a Gauss-Newton preconditioner and achieves state-of-the-art performance on image generation tasks while maintaining computational efficiency.