This paper introduces a rate-distortion framework for Markov chains that provides a unified variational view on the optimality of various Markov Chain Monte Carlo (MCMC) algorithms. It also analyzes the factorizability and geometry of multivariate Markov chains.
