Optimal Estimation of Missing Mass in a Markovian Sequence

We develop a linear-runtime estimator called Windowed Good-Turing (WingIt) that achieves minimax-optimal risk decay for estimating the stationary missing mass in a Markovian sequence, up to a logarithmic factor. We also provide a bound on the variance of the missing mass random variable.