Online statistical inference for nonlinear stochastic approximation with markovian data

X Li, J Liang, Z Zhang - arXiv preprint arXiv:2302.07690, 2023 - arxiv.org
We study the statistical inference of nonlinear stochastic approximation algorithms utilizing a
single trajectory of Markovian data. Our methodology has practical applications in various …

Asymptotic Time-Uniform Inference for Parameters in Averaged Stochastic Approximation

C Xie, K Jin, J Liang, Z Zhang - arXiv preprint arXiv:2410.15057, 2024 - arxiv.org
We study time-uniform statistical inference for parameters in stochastic approximation (SA),
which encompasses a bunch of applications in optimization and machine learning. To that …

Stochastic approximation mcmc, online inference, and applications in optimization of queueing systems

X Li, J Liang, X Chen, Z Zhang - arXiv preprint arXiv:2309.09545, 2023 - arxiv.org
Stochastic approximation Markov Chain Monte Carlo (SAMCMC) algorithms are a class of
online algorithms having wide-ranging applications, particularly within Markovian systems …

Gaussian Approximation and Multiplier Bootstrap for Polyak-Ruppert Averaged Linear Stochastic Approximation with Applications to TD Learning

S Samsonov, E Moulines, QM Shao, ZS Zhang… - arXiv preprint arXiv …, 2024 - arxiv.org
In this paper, we obtain the Berry-Esseen bound for multivariate normal approximation for
the Polyak-Ruppert averaged iterates of the linear stochastic approximation (LSA) algorithm …

Decoupled Functional Central Limit Theorems for Two-Time-Scale Stochastic Approximation

Y Han, X Li, J Liang, Z Zhang - arXiv preprint arXiv:2412.17070, 2024 - arxiv.org
In two-time-scale stochastic approximation (SA), two iterates are updated at different rates,
governed by distinct step sizes, with each update influencing the other. Previous studies …

Online statistical inference for stochastic optimization via Kiefer-Wolfowitz methods

X Chen, Z Lai, H Li, Y Zhang - Journal of the American Statistical …, 2024 - Taylor & Francis
This article investigates the problem of online statistical inference of model parameters in
stochastic optimization problems via the Kiefer-Wolfowitz algorithm with random search …

[PDF][PDF] A Selective Overview of Quantile Regression for Large-scale Data

S Wang, W Cao, XX Hu, H Zhong, W Sun - 2025 - preprints.org
Large-scale data characterized by heterogeneity due to heteroscedastic variance or
inhomogeneous covariate effects arises in diverse fields of scientific research and …