Language model behavior: A comprehensive survey

TA Chang, BK Bergen - Computational Linguistics, 2024 - direct.mit.edu
Transformer language models have received widespread public attention, yet their
generated text is often surprising even to NLP researchers. In this survey, we discuss over …

Pragmatic language interpretation as probabilistic inference

ND Goodman, MC Frank - Trends in cognitive sciences, 2016 - cell.com
Understanding language requires more than the use of fixed conventions and more than
decoding combinatorial structure. Instead, comprehenders make exquisitely sensitive …

Learning language games through interaction

SI Wang, P Liang, CD Manning - arXiv preprint arXiv:1606.02447, 2016 - arxiv.org
We introduce a new language learning setting relevant to building adaptive natural
language interfaces. It is inspired by Wittgenstein's language games: a human wishes to …

Reasoning about pragmatics with neural listeners and speakers

J Andreas, D Klein - arXiv preprint arXiv:1604.00562, 2016 - arxiv.org
We present a model for pragmatically describing scenes, in which contrastive behavior
results from a combination of inference-driven pragmatics and learned semantics. Like …

Multi-agent communication meets natural language: Synergies between functional and structural language learning

A Lazaridou, A Potapenko, O Tieleman - arXiv preprint arXiv:2005.07064, 2020 - arxiv.org
We present a method for combining multi-agent communication and traditional data-driven
approaches to natural language learning, with an end goal of teaching agents to …

Colors in context: A pragmatic neural model for grounded language understanding

W Monroe, RXD Hawkins, ND Goodman… - Transactions of the …, 2017 - direct.mit.edu
We present a model of pragmatic referring expression interpretation in a grounded
communication task (identifying colors from descriptions) that draws upon predictions from …

Cobra frames: Contextual reasoning about effects and harms of offensive statements

X Zhou, H Zhu, A Yerukola, T Davidson… - arXiv preprint arXiv …, 2023 - arxiv.org
Warning: This paper contains content that may be offensive or upsetting. Understanding the
harms and offensiveness of statements requires reasoning about the social and situational …

Unified pragmatic models for generating and following instructions

D Fried, J Andreas, D Klein - arXiv preprint arXiv:1711.04987, 2017 - arxiv.org
We show that explicit pragmatic inference aids in correctly generating and following natural
language instructions for complex, sequential tasks. Our pragmatics-enabled models reason …

Few-shot language coordination by modeling theory of mind

H Zhu, G Neubig, Y Bisk - International Conference on …, 2021 - proceedings.mlr.press
No man is an island. Humans develop the ability to communicate with a large community by
coordinating with different interlocutors within short conversations. This ability is largely …

Pragmatically informative image captioning with character-level inference

R Cohn-Gordon, N Goodman, C Potts - arXiv preprint arXiv:1804.05417, 2018 - arxiv.org
We combine a neural image captioner with a Rational Speech Acts (RSA) model to make a
system that is pragmatically informative: its objective is to produce captions that are not …