Large language models (LMs) offer unprecedented language generation capabilities and
exciting opportunities for interaction design. However, their highly context-dependent …

Code-generating large language models map natural language to code. However, only a
small portion of the infinite space of naturalistic utterances is effective at guiding code …

We introduce a large scale crowdsourced text adventure game as a research platform for
studying grounded dialogue. In it, agents can perceive, emote, and act whilst conducting …

Training accurate classifiers requires many labels, but each label provides only limited
information (one bit for binary classification). In this work, we propose BabbleLabble, a …

We wish to develop interactive agents that can communicate with humans to collaboratively
solve tasks in grounded scenarios. Since computer games allow us to simulate such tasks …

Building agents capable of understanding language instructions is critical to effective and
robust human-AI collaboration. Recent work focuses on training these agents via …

Dialogue systems, also called chatbots, are now used in a wide range of applications.
However, they still have some major weaknesses. One key weakness is that they are …

Abstract Language communication plays an important role in human learning and
knowledge acquisition. With the emergence of a new generation of cognitive robots …

Developing agents that can learn to follow natural language instructions has been an
emerging research direction. While being accessible and flexible, natural language …

We introduce EQUI-VOCAL: a new system that automatically synthesizes queries over
videos from limited user interactions. The user only provides a handful of positive and …