The authors introduce efficient Riemannian optimization methods that eliminate inner loops, providing simpler proofs and sharp convergence guarantees.