Within the vast expanse of computerized language processing, a revolutionary entity known
as Large Language Models (LLMs) has emerged, wielding immense power in its capacity to …

We introduce Voyager, the first LLM-powered embodied lifelong learning agent in Minecraft
that continuously explores the world, acquires diverse skills, and makes novel discoveries …

Constructing AI models that respond to text instructions is challenging, especially for
sequential decision-making tasks. This work introduces an instruction-tuned Video …

Large language models (LLMs) provide a new way to build chatbots by accepting natural
language prompts. Yet, it is unclear how to design prompts to power chatbots to carry on …

Large language models (LLMs) hold interesting potential for the design, development, and
research of video games. Building on the decades of prior research on generative AI in …

We present Large Language Model for Mixed Reality (LLMR), a framework for the real-time
creation and modification of interactive Mixed Reality experiences using LLMs. LLMR …

Object hallucination poses a significant challenge in vision-language (VL) models, often
leading to the generation of nonsensical or unfaithful responses with non-existent objects …

Abstract The Abstraction and Reasoning Corpus (ARC) is a set of procedural tasks that tests
an agent's ability to flexibly solve novel problems. While most ARC tasks are easy for …

The development of large language models (LLMs) capable of following instructions and
engaging in conversational interactions sparked increased interest in their utilization across …

We explore how interaction with large language models (LLMs) can give rise to emergent
behaviors, empowering players to participate in the evolution of game narratives. Our …