RSGD
S. Bonnabel, “Stochastic gradient descent on Riemannian manifolds”, IEEE Transactions on Automatic Control, Volume 58, Issue 9, pages 2217–2229, 2013.
RSVRG
H. Zhang, S. Reddi, S. Sra, “Riemannian SVRG: fast stochastic optimization on Riemannian Manifolds”, Advances in Neural Information Processing Systems, NIPS 2016, pages 4592–4600, 2016.
MASAGA
R. Babanezhad, I. Laradji, A. Shafaei, M. Schmidt, “MASAGA: A Linearly-Convergent Stochastic First-Order Method for Optimization on Manifolds”, Preprint, September 2018.