Proposing a new variant of two-time-scale stochastic approximation to achieve O(1/k) convergence rate in mean-squared errors.
Non-asymptotic performance of stochastic approximation with delayed updates under Markovian sampling.