Finite-Horizon Approximations and Episodic Equilibrium for Stochastic Games

This paper proposes a finite-horizon approximation scheme and introduces episodic equilibrium as a solution concept for stochastic games, bridging the gap between finite and infinite-horizon stochastic games and providing a unifying framework for time-averaged and discounted utilities.