Efficient and scalable bayesian neural nets with rank-1 factors

M Dusenberry, G Jerfel, Y Wen, Y Ma… - International …, 2020 - proceedings.mlr.press
Bayesian neural networks (BNNs) demonstrate promising success in improving the
robustness and uncertainty quantification of modern deep learning. However, they generally …

Bayesian compression for deep learning

C Louizos, K Ullrich, M Welling - Advances in neural …, 2017 - proceedings.neurips.cc
Compression and computational efficiency in deep learning have become a problem of
great significance. In this work, we argue that the most principled and effective way to attack …

Oops i took a gradient: Scalable sampling for discrete distributions

W Grathwohl, K Swersky, M Hashemi… - International …, 2021 - proceedings.mlr.press
We propose a general and scalable approximate sampling strategy for probabilistic models
with discrete variables. Our approach uses gradients of the likelihood function with respect …

Lasso meets horseshoe

A Bhadra, J Datta, NG Polson, B Willard - Statistical Science, 2019 - JSTOR
The goal of this paper is to contrast and survey the major advances in two of the most
commonly used high-dimensional techniques, namely, the Lasso and horseshoe …

Structured variational learning of Bayesian neural networks with horseshoe priors

S Ghosh, J Yao, F Doshi-Velez - … Conference on Machine …, 2018 - proceedings.mlr.press
Abstract Bayesian Neural Networks (BNNs) have recently received increasing attention for
their ability to provide well-calibrated posterior uncertainties. However, model selection …

Model selection in Bayesian neural networks via horseshoe priors

S Ghosh, J Yao, F Doshi-Velez - Journal of Machine Learning Research, 2019 - jmlr.org
The promise of augmenting accurate predictions provided by modern neural networks with
well-calibrated predictive uncertainties has reinvigorated interest in Bayesian neural …

Variational auto-encoding of protein sequences

S Sinai, E Kelsic, GM Church, MA Nowak - arXiv preprint arXiv …, 2017 - arxiv.org
Proteins are responsible for the most diverse set of functions in biology. The ability to extract
information from protein sequences and to predict the effects of mutations is extremely …

Non-identifiability and the blessings of misspecification in models of molecular fitness

E Weinstein, A Amin, J Frazer… - Advances in neural …, 2022 - proceedings.neurips.cc
Understanding the consequences of mutation for molecular fitness and function is a
fundamental problem in biology. Recently, generative probabilistic models have emerged as …

Fast and accurate variational inference for models with many latent variables

R Loaiza-Maya, MS Smith, DJ Nott, PJ Danaher - Journal of Econometrics, 2022 - Elsevier
Abstract Models with a large number of latent variables are often used to utilize the
information in big or complex data, but can be difficult to estimate. Variational inference …

Model selection in Bayesian neural networks via horseshoe priors

S Ghosh, F Doshi-Velez - arXiv preprint arXiv:1705.10388, 2017 - arxiv.org
Bayesian Neural Networks (BNNs) have recently received increasing attention for their
ability to provide well-calibrated posterior uncertainties. However, model selection---even …