Let the flows tell: Solving graph combinatorial problems with gflownets

D Zhang, H Dai, N Malkin… - Advances in neural …, 2023 - proceedings.neurips.cc
Combinatorial optimization (CO) problems are often NP-hard and thus out of reach for exact
algorithms, making them a tempting domain to apply machine learning methods. The highly …

Amortizing intractable inference in large language models

EJ Hu, M Jain, E Elmoznino, Y Kaddar, G Lajoie… - arXiv preprint arXiv …, 2023 - arxiv.org
Autoregressive large language models (LLMs) compress knowledge from their training data
through next-token conditional distributions. This limits tractable querying of this knowledge …

Diffusion generative flow samplers: Improving learning signals through partial trajectory optimization

D Zhang, RTQ Chen, CH Liu, A Courville… - arXiv preprint arXiv …, 2023 - arxiv.org
We tackle the problem of sampling from intractable high-dimensional density functions, a
fundamental task that often appears in machine learning and statistics. We extend recent …

Local search gflownets

M Kim, T Yun, E Bengio, D Zhang, Y Bengio… - arXiv preprint arXiv …, 2023 - arxiv.org
Generative Flow Networks (GFlowNets) are amortized sampling methods that learn a
distribution over discrete objects proportional to their rewards. GFlowNets exhibit a …

Learning to scale logits for temperature-conditional gflownets

M Kim, J Ko, T Yun, D Zhang, L Pan, W Kim… - arXiv preprint arXiv …, 2023 - arxiv.org
GFlowNets are probabilistic models that sequentially generate compositional structures
through a stochastic policy. Among GFlowNets, temperature-conditional GFlowNets can …

Discrete probabilistic inference as control in multi-path environments

T Deleu, P Nouri, N Malkin, D Precup… - arXiv preprint arXiv …, 2024 - arxiv.org
We consider the problem of sampling from a discrete and structured distribution as a
sequential decision problem, where the objective is to find a stochastic policy such that …

PhyloGFN: Phylogenetic inference with generative flow networks

M Zhou, Z Yan, E Layne, N Malkin, D Zhang… - arXiv preprint arXiv …, 2023 - arxiv.org
Phylogenetics is a branch of computational biology that studies the evolutionary
relationships among biological entities. Its long history and numerous applications …

Expected flow networks in stochastic environments and two-player zero-sum games

M Jiralerspong, B Sun, D Vucetic, T Zhang… - arXiv preprint arXiv …, 2023 - arxiv.org
Generative flow networks (GFlowNets) are sequential sampling models trained to match a
given distribution. GFlowNets have been successfully applied to various structured object …

GFlowNets for Causal Discovery: an Overview

DC Manta, EJ Hu, Y Bengio - ICML 2023 Workshop on Structured …, 2023 - openreview.net
Causal relationships underpin modern science and our ability to reason. Automatically
discovering useful causal relationships can greatly accelerate scientific progress and …

Variational DAG Estimation via State Augmentation With Stochastic Permutations

EV Bonilla, P Elinas, H Zhao, M Filippone… - arXiv preprint arXiv …, 2024 - arxiv.org
Estimating the structure of a Bayesian network, in the form of a directed acyclic graph (DAG),
from observational data is a statistically and computationally hard problem with essential …