Hands-on Bayesian neural networks—A tutorial for deep learning users

LV Jospin, H Laga, F Boussaid… - IEEE Computational …, 2022 - ieeexplore.ieee.org
Modern deep learning methods constitute incredibly powerful tools to tackle a myriad of
challenging problems. However, since deep learning methods operate as black boxes, the …

Towards Bayesian deep learning: A framework and some existing methods

H Wang, DY Yeung - IEEE Transactions on Knowledge and …, 2016 - ieeexplore.ieee.org
While perception tasks such as visual object recognition and text understanding play an
important role in human intelligence, subsequent tasks that involve inference, reasoning …

How good is the Bayes posterior in deep neural networks really?

F Wenzel, K Roth, BS Veeling, J Świątkowski… - arXiv preprint arXiv …, 2020 - arxiv.org
During the past five years the Bayesian deep learning community has developed
increasingly accurate and efficient approximate inference procedures that allow for …

Bayesian neural networks: An introduction and survey

E Goan, C Fookes - Case Studies in Applied Bayesian Data Science …, 2020 - Springer
Abstract Neural Networks (NNs) have provided state-of-the-art results for many challenging
machine learning tasks such as detection, regression and classification across the domains …

Specifying weight priors in bayesian deep neural networks with empirical bayes

R Krishnan, M Subedar, O Tickoo - Proceedings of the AAAI conference on …, 2020 - aaai.org
Stochastic variational inference for Bayesian deep neural network (DNN) requires specifying
priors and approximate posterior distributions over neural network weights. Specifying …

All you need is a good functional prior for Bayesian deep learning

BH Tran, S Rossi, D Milios, M Filippone - Journal of Machine Learning …, 2022 - jmlr.org
The Bayesian treatment of neural networks dictates that a prior distribution is specified over
their weight and bias parameters. This poses a challenge because modern neural networks …

Bayesian neural networks

V Mullachery, A Khera, A Husain - arXiv preprint arXiv:1801.07710, 2018 - arxiv.org
This paper describes and discusses Bayesian Neural Network (BNN). The paper showcases
a few different applications of them for classification and regression problems. BNNs are …

The case for Bayesian deep learning

AG Wilson - arXiv preprint arXiv:2001.10995, 2020 - arxiv.org
The key distinguishing property of a Bayesian approach is marginalization instead of
optimization, not the prior, or Bayes rule. Bayesian inference is especially compelling for …

Priors in bayesian deep learning: A review

V Fortuin - International Statistical Review, 2022 - Wiley Online Library
While the choice of prior is one of the most critical parts of the Bayesian inference workflow,
recent Bayesian deep learning models have often fallen back on vague priors, such as …

Bayesian uncertainty estimation for batch normalized deep networks

M Teye, H Azizpour, K Smith - International conference on …, 2018 - proceedings.mlr.press
We show that training a deep network using batch normalization is equivalent to
approximate inference in Bayesian models. We further demonstrate that this finding allows …