Estimating the number of components in finite mixture models via the Group-Sort-Fuse procedure

T Manole, A Khalili - The Annals of Statistics, 2021 - projecteuclid.org
Estimating the number of components in finite mixture models via the Group-Sort-Fuse
procedure Page 1 The Annals of Statistics 2021, Vol. 49, No. 6, 3043–3069 https://doi.org/10.1214/21-AOS2072 …

Towards convergence rates for parameter estimation in Gaussian-gated mixture of experts

H Nguyen, TT Nguyen, K Nguyen… - … Conference on Artificial …, 2024 - proceedings.mlr.press
Originally introduced as a neural network for ensemble learning, mixture of experts (MoE)
has recently become a fundamental building block of highly successful modern deep neural …

Refined convergence rates for maximum likelihood estimation under finite mixture models

T Manole, N Ho - International Conference on Machine …, 2022 - proceedings.mlr.press
We revisit the classical problem of deriving convergence rates for the maximum likelihood
estimator (MLE) in finite mixture models. The Wasserstein distance has become a standard …

Convergence rates for Gaussian mixtures of experts

N Ho, CY Yang, MI Jordan - Journal of Machine Learning Research, 2022 - jmlr.org
We provide a theoretical treatment of over-specified Gaussian mixtures of experts with
covariate-free gating networks. We establish the convergence rates of the maximum …

Minimax optimal rate for parameter estimation in multivariate deviated models

D Do, H Nguyen, K Nguyen… - Advances in Neural …, 2023 - proceedings.neurips.cc
We study the maximum likelihood estimation (MLE) in the multivariate deviated model where
the data are generated from the density function $(1-\lambda^{\ast}) h_ {0}(x)+\lambda^{\ast} …

Identifiability of nonparametric mixture models and bayes optimal clustering

B Aragam, C Dan, EP Xing, P Ravikumar - 2020 - projecteuclid.org
Identifiability of nonparametric mixture models and Bayes optimal clustering Page 1 The
Annals of Statistics 2020, Vol. 48, No. 4, 2277–2302 https://doi.org/10.1214/19-AOS1887 © …

Bayesian model selection via mean-field variational approximation

Y Zhang, Y Yang - Journal of the Royal Statistical Society Series …, 2024 - academic.oup.com
This article considers Bayesian model selection via mean-field (MF) variational
approximation. Towards this goal, we study the non-asymptotic properties of MF inference …

A diffusion process perspective on posterior contraction rates for parameters

W Mou, N Ho, MJ Wainwright, P Bartlett… - arXiv preprint arXiv …, 2019 - arxiv.org
We analyze the posterior contraction rates of parameters in Bayesian models via the
Langevin diffusion process, in particular by controlling moments of the stochastic process …

Uniform consistency in nonparametric mixture models

B Aragam, R Yang - The Annals of Statistics, 2023 - projecteuclid.org
Uniform consistency in nonparametric mixture models Page 1 The Annals of Statistics 2023,
Vol. 51, No. 1, 362–390 https://doi.org/10.1214/22-AOS2255 © Institute of Mathematical …

Strong identifiability and parameter learning in regression with heterogeneous response

D Do, L Do, XL Nguyen - Electronic Journal of Statistics, 2025 - projecteuclid.org
Mixtures of regression are useful for regression learning with respect to an uncertain and
heterogeneous response variable of interest. In addition to being a rich predictive model for …