Global convergence of the heavy-ball method for convex optimization

E Ghadimi, HR Feyzmahdavian… - 2015 European control …, 2015 - ieeexplore.ieee.org
Heavyball method on convex optimization problems with Lipschitzcontinuous gradient, with
and without the additional assumption of strong convexity… for quadratic programming,” Naval …

Convergence rates of the heavy ball method for quasi-strongly convex optimization

JF Aujol, C Dossal, A Rondepierre - SIAM Journal on Optimization, 2022 - SIAM
… The schemes of Nesterov [24] and Siegel [30] and the ones introduced in this paper are
built to be as efficient as possible for strongly convex functions (but not for quadratic functions). …

Analysis of the heavy-ball algorithm using integral quadratic constraints

A Badithela, P Seiler - 2019 American control conference (ACC …, 2019 - ieeexplore.ieee.org
… The parameters are chosen to the values that provide the optimal convergence rate for the
class of convex quadratic functions in S(m, L) [10], [… The Heavy-ball method can be written as: …

Stochastic heavy ball

S Gadat, F Panloup, S Saadane - 2018 - projecteuclid.org
… We then examine the situation of convex and strongly convex potentials and … problem is
more involved and we propose a result for the quadratic error only when f is a quadratic function (…

Quadratic minimization: from conjugate gradient to an adaptive Heavy-ball method with Polyak step-sizes

B Goujaud, A Taylor, A Dieuleveut - arXiv preprint arXiv:2210.06367, 2022 - arxiv.org
… on the classical Heavy-ball method for convex quadratic minimization. The … problem at
hand instead of problem parameters such as a few eigenvalues of the Hessian of the problem. …

Heavy Ball Momentum for Non-Strongly Convex Optimization

JF Aujol, C Dossal, H Labarrière… - arXiv preprint arXiv …, 2024 - arxiv.org
… number of the objective function, these methods guarantee a fast exponential … Heavy
Ball schemes) is relevant in a relaxed setting, ie for composite functions satisfying a quadratic

An accelerated Lyapunov function for Polyak's heavy-ball on convex quadratics

A Orvieto - Optimization Letters, 2024 - Springer
… are able to construct a Lyapunov function that demonstrates an \(O(1/k^2)\) rate for Heavy-ball
in the case of convex quadratic problems. Our novel proof technique, though restricted to …

Averaged heavy-ball method

M Danilova, G Malinovsky - arXiv preprint arXiv:2111.05430, 2021 - arxiv.org
… averaged version of Heavy-Ball method (AHB). We show that for quadratic problems
AHB has a … Moreover, for general convex and strongly convex functions, we prove non-accelerated …

Provable non-accelerations of the heavy-ball method

B Goujaud, A Taylor, A Dieuleveut - arXiv preprint arXiv:2307.11291, 2023 - arxiv.org
heavy-ball (HB) method provably does not reach an accelerated convergence rate on smooth
strongly convex problems. … of convex quadratic functions, or the set of strongly convex and …

Optimal first-order methods for convex functions with a quadratic upper bound

B Goujaud, A Taylor, A Dieuleveut - arXiv preprint arXiv:2205.15033, 2022 - arxiv.org
… A lower complexity bound on the convergence of any first-order method is provided in Section
2.2. In Section 2.3, we introduce the heavy-ball method under consideration and prove its …