Markov chain Monte Carlo in practice

GL Jones, Q Qin - Annual Review of Statistics and Its Application, 2022 - annualreviews.org
Markov chain Monte Carlo (MCMC) is an essential set of tools for estimating features of
probability distributions commonly encountered in modern applications. For MCMC …

Analyzing Markov chain Monte Carlo output

D Vats, N Robertson, JM Flegal… - Wiley Interdisciplinary …, 2020 - Wiley Online Library
Abstract Markov chain Monte Carlo (MCMC) is a sampling‐based method for estimating
features of probability distributions. MCMC methods produce a serially correlated, yet …

Solving the Poisson equation using coupled Markov chains

R Douc, PE Jacob, A Lee, D Vats - arXiv preprint arXiv:2206.05691, 2022 - arxiv.org
This article shows how coupled Markov chains that meet exactly after a random number of
iterations can be used to generate unbiased estimators of the solutions of the Poisson …

Multivariate moment least-squares variance estimators for reversible Markov chains

H Song, S Berg - Journal of Computational and Graphical Statistics, 2024 - Taylor & Francis
Abstract Markov chain Monte Carlo (MCMC) is a commonly used method for approximating
expectations with respect to probability distributions. Uncertainty assessment for MCMC …

Implementing MCMC: Multivariate estimation with confidence

JM Flegal, RP Kurtz-Garcia - arXiv preprint arXiv:2408.15396, 2024 - arxiv.org
This paper addresses the key challenge of estimating the asymptotic covariance associated
with the Markov chain central limit theorem, which is essential for visualizing and terminating …

Multivariate strong invariance principles in Markov chain Monte Carlo

A Banerjee, D Vats - Electronic Journal of Statistics, 2024 - projecteuclid.org
Strong invariance principles in Markov chain Monte Carlo are crucial to theoretically
grounded output analysis. Using the wide-sense regenerative nature of ergodic Markov …

Efficient shape-constrained inference for the autocovariance sequence from a reversible Markov chain

S Berg, H Song - The Annals of Statistics, 2023 - projecteuclid.org
Efficient shape-constrained inference for the autocovariance sequence from a reversible
Markov chain Page 1 The Annals of Statistics 2023, Vol. 51, No. 6, 2440–2470 https://doi.org/10.1214/23-AOS2335 …

Making mean-estimation more efficient using an MCMC trace variance approach: DynaMITE

C Cousins, S Haddadan, E Upfal - arXiv preprint arXiv:2011.11129, 2020 - arxiv.org
We introduce a novel statistical measure for MCMC-mean estimation, the inter-trace
variance ${\rm trv}^{(\tau_ {rel})}({\cal M}, f) $, which depends on a Markov chain ${\cal M} …

Estimating Monte Carlo variance from multiple Markov chains

K Gupta, D Vats - arXiv preprint arXiv:2007.04229, 2020 - arxiv.org
The ever-increasing power of the personal computer has led to easy parallel
implementations of Markov chain Monte Carlo (MCMC). However, almost all work in …

On the Utility of Equal Batch Sizes for Inference in Stochastic Gradient Descent

R Singh, A Shukla, D Vats - arXiv preprint arXiv:2303.07706, 2023 - arxiv.org
Stochastic gradient descent (SGD) is an estimation tool for large data employed in machine
learning and statistics. Due to the Markovian nature of the SGD process, inference is a …