Optimizing Physics-Informed Neural Networks: Achieving Global Minimization of Residual Loss through Wide Networks and Effective Activations

The residual loss in Physics-Informed Neural Networks (PINNs) can be globally minimized by using wide neural networks with activation functions that have well-behaved high-order derivatives.