Uncertainty quantification in machine learning for engineering design and health prognostics: A tutorial

V Nemani, L Biggio, X Huan, Z Hu, O Fink… - … Systems and Signal …, 2023 - Elsevier
On top of machine learning (ML) models, uncertainty quantification (UQ) functions as an
essential layer of safety assurance that could lead to more principled decision making by …

Priors in bayesian deep learning: A review

V Fortuin - International Statistical Review, 2022 - Wiley Online Library
While the choice of prior is one of the most critical parts of the Bayesian inference workflow,
recent Bayesian deep learning models have often fallen back on vague priors, such as …

Assaying out-of-distribution generalization in transfer learning

F Wenzel, A Dittadi, P Gehler… - Advances in …, 2022 - proceedings.neurips.cc
Since out-of-distribution generalization is a generally ill-posed problem, various proxy
targets (eg, calibration, adversarial robustness, algorithmic corruptions, invariance across …

Repulsive deep ensembles are bayesian

F D'Angelo, V Fortuin - Advances in Neural Information …, 2021 - proceedings.neurips.cc
Deep ensembles have recently gained popularity in the deep learning community for their
conceptual simplicity and efficiency. However, maintaining functional diversity between …

Prior and posterior networks: A survey on evidential deep learning methods for uncertainty estimation

D Ulmer, C Hardmeier, J Frellsen - arXiv preprint arXiv:2110.03051, 2021 - arxiv.org
Popular approaches for quantifying predictive uncertainty in deep neural networks often
involve distributions over weights or multiple models, for instance via Markov Chain …

Toward facial expression recognition in the wild via noise-tolerant network

Y Gu, H Yan, X Zhang, Y Wang, Y Ji… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Facial Expression Recognition (FER) has recently emerged as a crucial area in Human-
Computer Interaction (HCI) system for understanding the user's inner state and intention …

Understanding pathologies of deep heteroskedastic regression

E Wong-Toi, A Boyd, V Fortuin, S Mandt - arXiv preprint arXiv:2306.16717, 2023 - arxiv.org
Several recent studies have reported negative results when using heteroskedastic neural
regression models to model real-world data. In particular, for overparameterized models, the …

Massively scaling heteroscedastic classifiers

M Collier, R Jenatton, B Mustafa, N Houlsby… - arXiv preprint arXiv …, 2023 - arxiv.org
Heteroscedastic classifiers, which learn a multivariate Gaussian distribution over prediction
logits, have been shown to perform well on image classification problems with hundreds to …

Transferable Candidate Proposal with Bounded Uncertainty

K Go, KH Kim - arXiv preprint arXiv:2312.04604, 2023 - arxiv.org
From an empirical perspective, the subset chosen through active learning cannot guarantee
an advantage over random sampling when transferred to another model. While it …

[PDF][PDF] On the Choice of Priors in Bayesian Deep Learning

V Fortuin - 2021 - research-collection.ethz.ch
Deep learning has positioned itself as one of the most promising directions of machine
learning in recent years. Nonetheless, deep neural networks have many shortcomings, for …