Forward-backward Gaussian variational inference via JKO in the Bures-Wasserstein space

MZ Diao, K Balasubramanian… - … on Machine Learning, 2023 - proceedings.mlr.press
Variational inference (VI) seeks to approximate a target distribution $\pi $ by an element of a
tractable family of distributions. Of key interest in statistics and machine learning is Gaussian …

A riemannian admm

J Li, S Ma, T Srivastava - arXiv preprint arXiv:2211.02163, 2022 - arxiv.org
We consider a class of Riemannian optimization problems where the objective is the sum of
a smooth function and a nonsmooth function, considered in the ambient space. This class of …

A Riemannian Smoothing Steepest Descent Method for Non-Lipschitz Optimization on Embedded Submanifolds of

C Zhang, X Chen, S Ma - Mathematics of Operations …, 2024 - pubsonline.informs.org
In this paper, we study the generalized subdifferentials and the Riemannian gradient
subconsistency that are the basis for non-Lipschitz optimization on embedded submanifolds …

Stochastic zeroth-order Riemannian derivative estimation and optimization

J Li, K Balasubramanian, S Ma - Mathematics of Operations …, 2023 - pubsonline.informs.org
We consider stochastic zeroth-order optimization over Riemannian submanifolds embedded
in Euclidean space, where the task is to solve Riemannian optimization problems with only …

A Selective Overview of Recent Advances in Spectral Clustering and Their Applications

Y Xu, A Srinivasan, L Xue - Modern Statistical Methods for Health …, 2021 - Springer
Clustering is a key technique in segmenting data into different groups of similar
observations. As clustering is an unsupervised learning method, the latent cluster …

Riemannian stochastic proximal gradient methods for nonsmooth optimization over the Stiefel manifold

B Wang, S Ma, L Xue - Journal of machine learning research, 2022 - jmlr.org
Riemannian optimization has drawn a lot of attention due to its wide applications in practice.
Riemannian stochastic first-order algorithms have been studied in the literature to solve …

Nonsmooth Optimization over the Stiefel Manifold and Beyond: Proximal Gradient Method and Recent Variants

S Chen, S Ma, A Man-Cho So, T Zhang - SIAM Review, 2024 - SIAM
We consider optimization problems over the Stiefel manifold whose objective function is the
summation of a smooth function and a nonsmooth function. Existing methods for solving this …

Spatial-Temporal Mamba Network for EEG-based Motor Imagery Classification

X Yang, Z Jia - International Conference on Advanced Data Mining …, 2024 - Springer
Motor imagery (MI) classification is key for brain-computer interfaces (BCIs). Until recent
years, numerous models had been proposed, ranging from classical algorithms like …

A Riemannian Alternating Direction Method of Multipliers

J Li, S Ma, T Srivastava - Mathematics of Operations …, 2024 - pubsonline.informs.org
We consider a class of Riemannian optimization problems where the objective is the sum of
a smooth function and a nonsmooth function considered in the ambient space. This class of …

Do algorithms and barriers for sparse principal component analysis extend to other structured settings?

G Wang, M Lou, A Pananjady - IEEE Transactions on Signal …, 2024 - ieeexplore.ieee.org
We study a principal component analysis problem under the spiked Wishart model in which
the structure in the signal is captured by a class of union-of-subspace models. This general …