From word models to world models: Translating from natural language to the probabilistic language of thought

L Wong, G Grand, AK Lew, ND Goodman… - arXiv preprint arXiv …, 2023 - arxiv.org
How does language inform our downstream thinking? In particular, how do humans make
meaning from language--and how can we leverage a theory of linguistic meaning to build …

3DP3: 3D scene perception via probabilistic programming

N Gothoskar, M Cusumano-Towner… - Advances in …, 2021 - proceedings.neurips.cc
We present 3DP3, a framework for inverse graphics that uses inference in a structured
generative model of objects, scenes, and images. 3DP3 uses (i) voxel models to represent …

Transforming worlds: Automated involutive MCMC for open-universe probabilistic models

G Matheos, AK Lew, M Ghavamizadeh… - Third Symposium on …, 2020 - openreview.net
Open-universe probabilistic models enable Bayesian inference about how many objects
underlie data, and how they are related. Effective inference in OUPMs remains a challenge …

Gen: a high-level programming platform for probabilistic inference

MF Cusumano-Towner - 2020 - dspace.mit.edu
Probabilistic inference provides a powerful theoretical framework for engineering intelligent
systems. However, diverse modeling approaches and inference algorithms are needed to …

Capturing Distributions over Worlds for Robotics with Spatial Scene Grammars

G Izatt - 2022 - dspace.mit.edu
Having a precise understanding of the distribution over worlds a robot will face is critical to
most problems in robotics. This distribution informs mechanical and software design …

Infrastructure for modeling and inference engineering with 3D generative scene graphs

AJ Garrett - 2021 - dspace.mit.edu
Recent advances in probabilistic programming have enabled the development of
probabilistic generative models for visual perception using a rich abstract representation of …