From word models to world models: Translating from natural language to the probabilistic language of thought

L Wong, G Grand, AK Lew, ND Goodman… - arXiv preprint arXiv …, 2023 - arxiv.org
How does language inform our downstream thinking? In particular, how do humans make
meaning from language--and how can we leverage a theory of linguistic meaning to build …

3DP3: 3D scene perception via probabilistic programming

N Gothoskar, M Cusumano-Towner… - Advances in …, 2021 - proceedings.neurips.cc
We present 3DP3, a framework for inverse graphics that uses inference in a structured
generative model of objects, scenes, and images. 3DP3 uses (i) voxel models to represent …

Online bayesian goal inference for boundedly rational planning agents

T Zhi-Xuan, J Mann, T Silver… - Advances in neural …, 2020 - proceedings.neurips.cc
People routinely infer the goals of others by observing their actions over time. Remarkably,
we can do so even when those actions lead to failure, enabling us to assist others when we …

ADEV: Sound automatic differentiation of expected values of probabilistic programs

AK Lew, M Huot, S Staton, VK Mansinghka - Proceedings of the ACM on …, 2023 - dl.acm.org
Optimizing the expected values of probabilistic processes is a central problem in computer
science and its applications, arising in fields ranging from artificial intelligence to operations …

Involutive MCMC: a unifying framework

K Neklyudov, M Welling, E Egorov… - … on Machine Learning, 2020 - proceedings.mlr.press
Abstract Markov Chain Monte Carlo (MCMC) is a computational approach to fundamental
problems such as inference, integration, optimization, and simulation. The field has …

Smcp3: Sequential monte carlo with probabilistic program proposals

AK Lew, G Matheos, T Zhi-Xuan… - International …, 2023 - proceedings.mlr.press
This paper introduces SMCP3, a method for automatically implementing custom sequential
Monte Carlo samplers for inference in probabilistic programs. Unlike particle filters and …

A general perspective on the Metropolis-Hastings kernel

C Andrieu, A Lee, S Livingstone - arXiv preprint arXiv:2012.14881, 2020 - arxiv.org
Since its inception the Metropolis-Hastings kernel has been applied in sophisticated ways to
address ever more challenging and diverse sampling problems. Its success stems from the …

Beyond Bayesian Model Averaging over Paths in Probabilistic Programs with Stochastic Support

T Reichelt, L Ong, T Rainforth - International Conference on …, 2024 - proceedings.mlr.press
The posterior in probabilistic programs with stochastic support decomposes as a weighted
sum of the local posterior distributions associated with each possible program path. We …

Automatically marginalized MCMC in probabilistic programming

J Lai, J Burroni, H Guan… - … Conference on Machine …, 2023 - proceedings.mlr.press
Abstract Hamiltonian Monte Carlo (HMC) is a powerful algorithm to sample latent variables
from Bayesian models. The advent of probabilistic programming languages (PPLs) frees …

Partially Observable Task and Motion Planning with Uncertainty and Risk Awareness

A Curtis, G Matheos, N Gothoskar… - arXiv preprint arXiv …, 2024 - arxiv.org
Integrated task and motion planning (TAMP) has proven to be a valuable approach to
generalizable long-horizon robotic manipulation and navigation problems. However, the …