Particle algorithms for maximum likelihood training of latent variable models

J Kuntz, JN Lim, AM Johansen - International Conference on …, 2023 - proceedings.mlr.press
Neal and Hinton (1998) recast maximum likelihood estimation of any given latent variable
model as the minimization of a free energy functional F, and the EM algorithm as coordinate …

Analysis of stochastic gradient descent in continuous time

J Latz - Statistics and Computing, 2021 - Springer
Stochastic gradient descent is an optimisation method that combines classical gradient
descent with random subsampling within the target functional. In this work, we introduce the …

[HTML][HTML] Optimal scaling of random-walk metropolis algorithms on general target distributions

J Yang, GO Roberts, JS Rosenthal - Stochastic Processes and their …, 2020 - Elsevier
One main limitation of the existing optimal scaling results for Metropolis–Hastings algorithms
is that the assumptions on the target distribution are unrealistic. In this paper, we consider …

Optimal scaling of MCMC beyond Metropolis

S Agrawal, D Vats, K Łatuszyński… - Advances in Applied …, 2023 - cambridge.org
The problem of optimally scaling the proposal distribution in a Markov chain Monte Carlo
algorithm is critical to the quality of the generated samples. Much work has gone into …

Scalable couplings for the random walk Metropolis algorithm

TP Papp, C Sherlock - Journal of the Royal Statistical Society …, 2024 - academic.oup.com
There has been a recent surge of interest in coupling methods for Markov chain Monte Carlo
algorithms: they facilitate convergence quantification and unbiased estimation, while …

Counterexamples for optimal scaling of Metropolis–Hastings chains with rough target densities

J Vogrinc, WS Kendall - 2021 - projecteuclid.org
For sufficiently smooth targets of product form it is known that the variance of a single
coordinate of the proposal in RWM (random walk Metropolis) and MALA (Metropolis …

Design of hybrid simulated annealing algorithm for UAV scheduling based on coordinated task scheduling

L Wu, Q Sun, H Xu, X Song… - 2021 40th Chinese …, 2021 - ieeexplore.ieee.org
Aiming at the issue of UAV coordinated scheduling, this paper attempts to construct a UAV
scheduling model based on an online coordination platform from the perspective of task …

Nonlocal stochastic-partial-differential-equation limits of spatially correlated noise-driven spin systems derived to sample a canonical distribution

Y Gao, JL Marzuola, JC Mattingly, KA Newhall - Physical Review E, 2020 - APS
For a noisy spin system, we derive a nonlocal stochastic version of the overdamped Landau-
Lipshitz equation designed to respect the underlying Hamiltonian structure and sample the …

[PDF][PDF] Non-stationary phase of the MALA algorithm with annealed proposals

M BÉDARD - 2024 - dms.umontreal.ca
Abstract The Metropolis-adjusted Langevin algorithm (MALA) is an informed MCMC method
that is used to sample from a target distribution of interest. Its proposal distribution makes …

Non-local SPDE limits of spatially-correlated-noise driven spin systems derived to sample a canonical distribution

Y Gao, JL Marzuola, J Mattingly, KA Newhall - arXiv preprint arXiv …, 2020 - arxiv.org
We study the macroscopic behavior of a stochastic spin ensemble driven by a discrete
Markov jump process motivated by the Metropolis-Hastings algorithm where the proposal is …