In this paper, we revisit\textsf {ROOT-SGD}, an innovative method for stochastic optimization
to bridge the gap between stochastic optimization and statistical efficiency. The proposed …

Stochastic gradient descent (SGD) is a powerful optimization technique that is particularly
useful in online learning scenarios. Its convergence analysis is relatively well understood …