Sequential monte carlo steering of large language models using probabilistic programs

AK Lew, T Zhi-Xuan, G Grand… - arXiv preprint arXiv …, 2023 - arxiv.org
Even after fine-tuning and reinforcement learning, large language models (LLMs) can be
difficult, if not impossible, to control reliably with prompts alone. We propose a new inference …

Sequential Monte Carlo learning for time series structure discovery

F Saad, B Patton, MD Hoffman… - International …, 2023 - proceedings.mlr.press
This paper presents a new approach to automatically discovering accurate models of
complex time series data. Working within a Bayesian nonparametric prior over a symbolic …

Smcp3: Sequential monte carlo with probabilistic program proposals

AK Lew, G Matheos, T Zhi-Xuan… - International …, 2023 - proceedings.mlr.press
This paper introduces SMCP3, a method for automatically implementing custom sequential
Monte Carlo samplers for inference in probabilistic programs. Unlike particle filters and …

Probabilistic Programming with Programmable Variational Inference

MCR Becker, AK Lew, X Wang, M Ghavami… - Proceedings of the …, 2024 - dl.acm.org
Compared to the wide array of advanced Monte Carlo methods supported by modern
probabilistic programming languages (PPLs), PPL support for variational inference (VI) is …

Probabilistic programming with stochastic probabilities

AK Lew, M Ghavamizadeh, MC Rinard… - Proceedings of the …, 2023 - dl.acm.org
We present a new approach to the design and implementation of probabilistic programming
languages (PPLs), based on the idea of stochastically estimating the probability density …

Variational nonlinear Kalman filtering with unknown process noise covariance

H Lan, J Hu, Z Wang, Q Cheng - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Motivated by the maneuvering target tracking with sensors such as radar and sonar, this
article considers the joint and recursive estimation of the dynamic state and the time-varying …

Infinite Ends from Finite Samples: Open-Ended Goal Inference as Top-Down Bayesian Filtering of Bottom-Up Proposals

T Zhi-Xuan, G Kang, V Mansinghka… - arXiv preprint arXiv …, 2024 - arxiv.org
The space of human goals is tremendously vast; and yet, from just a few moments of
watching a scene or reading a story, we seem to spontaneously infer a range of plausible …

Scalable Structure Learning, Inference, and Analysis with Probabilistic Programs

FAK Saad - 2022 - dspace.mit.edu
How can we automate and scale up the processes of learning accurate probabilistic models
of complex data and obtaining principled solutions to probabilistic inference and analysis …

Bayesian Structural Causal Inference with Probabilistic Programming

SA Witty - 2023 - scholarworks.umass.edu
Abstract Reasoning about causal relationships is central to the human experience. This
evokes a natural question in our pursuit of human-like artificial intelligence: how might we …

Serialization and Applications for the Gen Probabilistic Programming Language

I Limarta - 2023 - dspace.mit.edu
Probabilistic programming has emerged as a powerful framework for building expressive
models that can handle uncertainty in a wide range of applications. Serialization, the …