Accelerating stochastic sequential quadratic programming for equality constrained optimization using predictive variance reduction

AS Berahas, J Shi, Z Yi, B Zhou - Computational Optimization and …, 2023 - Springer
Computational Optimization and Applications, 2023Springer
In this paper, we propose a stochastic method for solving equality constrained optimization
problems that utilizes predictive variance reduction. Specifically, we develop a method
based on the sequential quadratic programming paradigm that employs variance reduction
in the gradient approximations. Under reasonable assumptions, we prove that a measure of
first-order stationarity evaluated at the iterates generated by our proposed algorithm
converges to zero in expectation from arbitrary starting points, for both constant and adaptive …
Abstract
In this paper, we propose a stochastic method for solving equality constrained optimization problems that utilizes predictive variance reduction. Specifically, we develop a method based on the sequential quadratic programming paradigm that employs variance reduction in the gradient approximations. Under reasonable assumptions, we prove that a measure of first-order stationarity evaluated at the iterates generated by our proposed algorithm converges to zero in expectation from arbitrary starting points, for both constant and adaptive step size strategies. Finally, we demonstrate the practical performance of our proposed algorithm on constrained binary classification problems that arise in machine learning.
Springer
以上显示的是最相近的搜索结果。 查看全部搜索结果

Google学术搜索按钮

example.edu/paper.pdf
搜索
获取 PDF 文件
引用
References