Nonconvex matrix factorization is geodesically convex: Global landscape analysis for fixed-rank matrix optimization from a riemannian perspective

Y Luo, NG Trillos - arXiv preprint arXiv:2209.15130, 2022 - arxiv.org
We study a general matrix optimization problem with a fixed-rank positive semidefinite (PSD)
constraint. We perform the Burer-Monteiro factorization and consider a particular …

Semidefinite programming versus burer-monteiro factorization for matrix sensing

B Yalçın, Z Ma, J Lavaei, S Sojoudi - … of the AAAI Conference on Artificial …, 2023 - ojs.aaai.org
Many fundamental low-rank optimization problems, such as matrix completion, phase
retrieval, and robust PCA, can be formulated as the matrix sensing problem. Two main …

The Landscape of Deterministic and Stochastic Optimal Control Problems: One-Shot Optimization Versus Dynamic Programming

J Kim, Y Ding, Y Bi, J Lavaei - IEEE Transactions on Automatic …, 2024 - ieeexplore.ieee.org
Optimal control problems can be solved via a one-shot (single) optimization or a sequence
of optimization using dynamic programming (DP). However, the computation of their global …

Spurious valleys, np-hardness, and tractability of sparse matrix factorization with fixed support

QT Le, E Riccietti, R Gribonval - SIAM Journal on Matrix Analysis and …, 2023 - SIAM
The problem of approximating a dense matrix by a product of sparse factors is a
fundamental problem for many signal processing and machine learning tasks. It can be …

A new complexity metric for nonconvex rank-one generalized matrix completion

H Zhang, B Yalcin, J Lavaei, S Sojoudi - Mathematical Programming, 2024 - Springer
In this work, we develop a new complexity metric for an important class of low-rank matrix
optimization problems in both symmetric and asymmetric cases, where the metric aims to …

Optimization over bounded-rank matrices through a desingularization enables joint global and local guarantees

Q Rebjock, N Boumal - arXiv preprint arXiv:2406.14211, 2024 - arxiv.org
Convergence guarantees for optimization over bounded-rank matrices are delicate to obtain
because the feasible set is a non-smooth and non-convex algebraic variety. Existing …

Computing local minimizers in polynomial optimization under genericity conditions

VT Hieu, A Takeda - arXiv preprint arXiv:2311.00838, 2023 - arxiv.org
In this paper, we aim at computing all local minimizers of a polynomial optimization problem
under genericity conditions. By using a technique in symbolic computation, we provide a …

A line-search descent algorithm for strict saddle functions with complexity guarantees

MJ O'Neill, SJ Wright - Journal of Machine Learning Research, 2023 - jmlr.org
We describe a line-search algorithm which achieves the best-known worst-case complexity
results for problems with a certain" strict saddle" property that has been observed to hold in …

[PDF][PDF] A Unified Complexity Metric for Nonconvex Matrix Completion and Matrix Sensing in the Rank-one Case

H Zhang, B Yalcin, J Lavaei… - arXiv preprint arXiv …, 2022 - researchgate.net
In this work, we develop a new complexity metric for an important class of low-rank matrix
optimization problems, where the metric aims to quantify the complexity of the nonconvex …

[PDF][PDF] Solving Matrix Completion as Noisy Matrix Sensing

Z Ma, S Sojoudi - gavenma.github.io
Matrix completion, a crucial sub-problem of non-convex matrix sensing, is integral to
numerous machine learning applications such as recommender systems. Traditionally …