Under sufficient entropy regularization, the independent natural policy gradient dynamics in multi-agent games converge linearly to the quantal response equilibrium.
