Online nonconvex optimization with limited instantaneous oracle feedback

Z Guan, Y Zhou, Y Liang - The Thirty Sixth Annual …, 2023 - proceedings.mlr.press
We investigate online nonconvex optimization from a local regret minimization perspective.
Previous studies along this line implicitly required the access to sufficient gradient oracles at …

Online bilevel optimization: Regret analysis of online alternating gradient methods

DA Tarzanagh, P Nazari, B Hou… - International …, 2024 - proceedings.mlr.press
This paper introduces\textit {online bilevel optimization} in which a sequence of time-varying
bilevel problems is revealed one after the other. We extend the known regret bounds for …

Local strong convexity of source localization and error bound for target tracking under time-of-arrival measurements

YM Pun, AMC So - IEEE Transactions on Signal Processing, 2021 - ieeexplore.ieee.org
In this paper, we consider a time-varying optimization approach to the problem of tracking a
moving target using noisy time-of-arrival (TOA) measurements. Specifically, we formulate the …

Adaptive first-order methods revisited: Convex minimization without lipschitz requirements

K Antonakopoulos… - Advances in Neural …, 2021 - proceedings.neurips.cc
We propose a new family of adaptive first-order methods for a class of convex minimization
problems that may fail to be Lipschitz continuous or smooth in the standard sense …

Generalized perturbed best response dynamics with a continuum of strategies

R Lahkar, S Mukherjee, S Roy - Journal of Economic Theory, 2022 - Elsevier
We consider a generalization of perturbed best response dynamics in population games
with a continuum of strategies. The previous literature has considered the logit dynamic …

Zeroth-order non-convex learning via hierarchical dual averaging

A Héliou, M Martin, P Mertikopoulos… - … on Machine Learning, 2021 - proceedings.mlr.press
We propose a hierarchical version of dual averaging for zeroth-order online non-convex
optimization {–} ie, learning processes where, at each stage, the optimizer is facing an …

Non-convex bilevel optimization with time-varying objective functions

S Lin, D Sow, K Ji, Y Liang… - Advances in Neural …, 2024 - proceedings.neurips.cc
Bilevel optimization has become a powerful tool in a wide variety of machine learning
problems. However, the current nonconvex bilevel optimization considers an offline dataset …

Learning in nonatomic games, Part I: Finite action spaces and population games

S Hadikhanloo, R Laraki, P Mertikopoulos… - arXiv preprint arXiv …, 2021 - arxiv.org
We examine the long-run behavior of a wide range of dynamics for learning in nonatomic
games, in both discrete and continuous time. The class of dynamics under consideration …

On the Hardness of Online Nonconvex Optimization with Single Oracle Feedback

Z Guan, Y Zhou, Y Liang - The Twelfth International Conference on …, 2024 - openreview.net
Online nonconvex optimization has been an active area of research recently. Previous
studies either considered the global regret with full information about the objective functions …

Gradient and projection free distributed online min-max resource optimization

J Wang, B Liang - Learning for Dynamics and Control …, 2022 - proceedings.mlr.press
We consider distributed online min-max resource allocation with a set of parallel agents and
a parameter server. Our goal is to minimize the pointwise maximum over a set of time …