Nonconvex optimization meets low-rank matrix factorization: An overview

Y Chi, YM Lu, Y Chen - IEEE Transactions on Signal …, 2019 - ieeexplore.ieee.org
Substantial progress has been made recently on developing provably accurate and efficient
algorithms for low-rank matrix factorization via nonconvex optimization. While conventional …

Canonical factors for hybrid neural fields

B Yi, W Zeng, S Buchanan… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Factored feature volumes offer a simple way to build more compact, efficient, and
intepretable neural fields, but also introduce biases that are not necessarily beneficial for …

The power of preconditioning in overparameterized low-rank matrix sensing

X Xu, Y Shen, Y Chi, C Ma - International Conference on …, 2023 - proceedings.mlr.press
Abstract We propose $\textsf {ScaledGD ($\lambda $)} $, a preconditioned gradient descent
method to tackle the low-rank matrix sensing problem when the true rank is unknown, and …

Nonconvex low-rank tensor completion from noisy data

C Cai, G Li, HV Poor, Y Chen - Advances in neural …, 2019 - proceedings.neurips.cc
We study a completion problem of broad practical interest: the reconstruction of a low-rank
symmetric tensor from highly incomplete and randomly corrupted observations of its entries …

From symmetry to geometry: Tractable nonconvex problems

Y Zhang, Q Qu, J Wright - arXiv preprint arXiv:2007.06753, 2020 - arxiv.org
As science and engineering have become increasingly data-driven, the role of optimization
has expanded to touch almost every stage of the data analysis pipeline, from signal and …

Complete dictionary learning via l4-norm maximization over the orthogonal group

Y Zhai, Z Yang, Z Liao, J Wright, Y Ma - Journal of Machine Learning …, 2020 - jmlr.org
This paper considers the fundamental problem of learning a complete (orthogonal)
dictionary from samples of sparsely generated signals. Most existing methods solve the …

Subgradient descent learns orthogonal dictionaries

Y Bai, Q Jiang, J Sun - arXiv preprint arXiv:1810.10702, 2018 - arxiv.org
This paper concerns dictionary learning, ie, sparse coding, a fundamental representation
learning problem. We show that a subgradient descent algorithm, with random initialization …

A nonconvex approach for exact and efficient multichannel sparse blind deconvolution

Q Qu, X Li, Z Zhu - Advances in neural information …, 2019 - proceedings.neurips.cc
We study the multi-channel sparse blind deconvolution (MCS-BD) problem, whose task is to
simultaneously recover a kernel $\mathbf a $ and multiple sparse inputs $\{\mathbf x_i\} _ {i …

Short-and-Sparse Deconvolution--A Geometric Approach

Y Lau, Q Qu, HW Kuo, P Zhou, Y Zhang… - arXiv preprint arXiv …, 2019 - arxiv.org
Short-and-sparse deconvolution (SaSD) is the problem of extracting localized, recurring
motifs in signals with spatial or temporal structure. Variants of this problem arise in …

Geometric analysis of nonconvex optimization landscapes for overcomplete learning

Q Qu, Y Zhai, X Li, Y Zhang, Z Zhu - International Conference on …, 2020 - openreview.net
Learning overcomplete representations finds many applications in machine learning and
data analytics. In the past decade, despite the empirical success of heuristic methods …