Proximal gradient algorithms under local Lipschitz gradient continuity: A convergence and robustness analysis of PANOC

A De Marchi, A Themelis - Journal of Optimization Theory and Applications, 2022 - Springer
Composite optimization offers a powerful modeling tool for a variety of applications and is
often numerically solved by means of proximal gradient methods. In this paper, we consider …

Complexity of an inexact proximal-point penalty method for constrained smooth non-convex optimization

Q Lin, R Ma, Y Xu - Computational optimization and applications, 2022 - Springer
In this paper, an inexact proximal-point penalty method is studied for constrained
optimization problems, where the objective function is non-convex, and the constraint …

Complexity of single loop algorithms for nonlinear programming with stochastic objective and constraints

A Alacaoglu, SJ Wright - International Conference on …, 2024 - proceedings.mlr.press
We analyze the sample complexity of single-loop quadratic penalty and augmented
Lagrangian algorithms for solving nonconvex optimization problems with functional equality …

A Newton-CG based augmented Lagrangian method for finding a second-order stationary point of nonconvex equality constrained optimization with complexity …

C He, Z Lu, TK Pong - SIAM Journal on Optimization, 2023 - SIAM
In this paper we consider finding a second-order stationary point (SOSP) of nonconvex
equality constrained optimization when a nearly feasible point is known. In particular, we first …

Orthogonal Directions Constrained Gradient Method: from non-linear equality constraints to Stiefel manifold

S Schechtman, D Tiapkin… - The Thirty Sixth …, 2023 - proceedings.mlr.press
We consider the problem of minimizing a non-convex function over a smooth manifold M.
We propose a novel algorithm, the Orthogonal Directions Constrained Gradient Method …

A stochastic primal-dual method for a class of nonconvex constrained optimization

L Jin, X Wang - Computational Optimization and Applications, 2022 - Springer
In this paper we study a class of nonconvex optimization which involves uncertainty in the
objective and a large number of nonconvex functional constraints. Challenges often arise …

Stochastic inexact augmented Lagrangian method for nonconvex expectation constrained optimization

Z Li, PY Chen, S Liu, S Lu, Y Xu - Computational Optimization and …, 2024 - Springer
Many real-world problems not only have complicated nonconvex functional constraints but
also use a large number of data points. This motivates the design of efficient stochastic …

An adaptive sampling augmented Lagrangian method for stochastic optimization with deterministic constraints

R Bollapragada, C Karamanli, B Keith… - … & Mathematics with …, 2023 - Elsevier
The primary goal of this paper is to provide an efficient solution algorithm based on the
augmented Lagrangian framework for optimization problems with a stochastic objective …

Iteration complexity of an inner accelerated inexact proximal augmented Lagrangian method based on the classical Lagrangian function

W Kong, JG Melo, RDC Monteiro - SIAM Journal on Optimization, 2023 - SIAM
This paper establishes the iteration complexity of an inner accelerated inexact proximal
augmented Lagrangian (IAIPAL) method for solving linearly constrained smooth nonconvex …

Iteration complexity of a proximal augmented Lagrangian method for solving nonconvex composite optimization problems with nonlinear convex constraints

W Kong, JG Melo… - Mathematics of Operations …, 2023 - pubsonline.informs.org
This paper proposes and analyzes a proximal augmented Lagrangian (NL-IAPIAL) method
for solving constrained nonconvex composite optimization problems, where the constraints …