Oops i took a gradient: Scalable sampling for discrete distributions

W Grathwohl, K Swersky, M Hashemi… - International …, 2021 - proceedings.mlr.press
We propose a general and scalable approximate sampling strategy for probabilistic models
with discrete variables. Our approach uses gradients of the likelihood function with respect …

Bayesdag: Gradient-based posterior inference for causal discovery

Y Annadani, N Pawlowski, J Jennings… - Advances in …, 2023 - proceedings.neurips.cc
Bayesian causal discovery aims to infer the posterior distribution over causal models from
observed data, quantifying epistemic uncertainty and benefiting downstream tasks …

A langevin-like sampler for discrete distributions

R Zhang, X Liu, Q Liu - International Conference on Machine …, 2022 - proceedings.mlr.press
We propose discrete Langevin proposal (DLP), a simple and scalable gradient-based
proposal for sampling complex high-dimensional discrete distributions. In contrast to Gibbs …

Convergence Diagnostics for Entity Resolution

S Aleshin-Guendel, RC Steorts - Annual Review of Statistics …, 2024 - annualreviews.org
Entity resolution is the process of merging and removing duplicate records from multiple
data sources, often in the absence of unique identifiers. Bayesian models for entity …

Revisiting sampling for combinatorial optimization

H Sun, K Goshvadi, A Nova… - International …, 2023 - proceedings.mlr.press
Sampling approaches like Markov chain Monte Carlo were once popular for combinatorial
optimization, but the inefficiency of classical methods and the need for problem-specific …

Improving protein optimization with smoothed fitness landscapes

A Kirjner, J Yim, R Samusevich, S Bracha… - The Twelfth …, 2023 - openreview.net
The ability to engineer novel proteins with higher fitness for a desired property would be
revolutionary for biotechnology and medicine. Modeling the combinatorially large space of …

Optimal scaling for locally balanced proposals in discrete spaces

H Sun, H Dai, D Schuurmans - Advances in Neural …, 2022 - proceedings.neurips.cc
Optimal scaling has been well studied for Metropolis-Hastings (MH) algorithms in
continuous spaces, but a similar understanding has been lacking in discrete spaces …

Masked Bayesian neural networks: Theoretical guarantee and its posterior inference

I Kong, D Yang, J Lee, I Ohn… - … on Machine Learning, 2023 - proceedings.mlr.press
Bayesian approaches for learning deep neural networks (BNN) have been received much
attention and successfully applied to various applications. Particularly, BNNs have the merit …

Plug & play directed evolution of proteins with gradient-based discrete MCMC

P Emami, A Perreault, J Law, D Biagioni… - … Learning: Science and …, 2023 - iopscience.iop.org
A long-standing goal of machine-learning-based protein engineering is to accelerate the
discovery of novel mutations that improve the function of a known protein. We introduce a …

Informed correctors for discrete diffusion models

Y Zhao, J Shi, L Mackey, S Linderman - arXiv preprint arXiv:2407.21243, 2024 - arxiv.org
Discrete diffusion modeling is a promising framework for modeling and generating data in
discrete spaces. To sample from these models, different strategies present trade-offs …