Abstract We propose SWA-Gaussian (SWAG), a simple, scalable, and general purpose approach for uncertainty representation and calibration in deep learning. Stochastic Weight …
F He, D Tao - arXiv preprint arXiv:2012.10931, 2020 - arxiv.org
Deep learning is usually described as an experiment-driven field under continuous criticizes of lacking theoretical foundations. This problem has been partially fixed by a large volume of …
We study statistical inference and distributionally robust solution methods for stochastic optimization problems, focusing on confidence intervals for optimal values and solutions that …
Bridging the gap between constant step size stochastic gradient descent and Markov chains Page 1 The Annals of Statistics 2020, Vol. 48, No. 3, 1348–1382 https://doi.org/10.1214/19-AOS1850 …
W Mou, L Wang, X Zhai… - Conference on Learning …, 2018 - proceedings.mlr.press
We study the generalization errors of\emph {non-convex} regularized ERM procedures using Stochastic Gradient Langevin Dynamics (SGLD). Two theories are proposed with non …
We study the implicit regularization of mini-batch stochastic gradient descent, when applied to the fundamental problem of least squares regression. We leverage a continuous-time …
XQ Li, LK Song, GC Bai - Engineering with Computers, 2023 - Springer
For complex structures like aeroengine turbine rotor, its reliability performance is jointly determined by multiple correlated failure modes. Probabilistic evaluation is an effective way …
We undertake a precise study of the asymptotic and non-asymptotic properties of stochastic approximation procedures with Polyak-Ruppert averaging for solving a linear system $\bar …
Coronary artery disease (CAD) is one of the main causes of cardiac death around the world. Due to its significant impact on the society, early and accurate detection of CAD is essential …