Language models demonstrate both quantitative improvement and new qualitative
capabilities with increasing scale. Despite their potentially transformative impact, these new …

Collaborative tasks are ubiquitous activities where a form of communication is required in
order to reach a joint goal. Collaborative building is one of such tasks. We wish to develop …

An ideal integration of autonomous agents in a human world implies that they are able to
collaborate on human terms. In particular, theory of mind plays an important role in …

Dialogue-based human-AI collaboration can revolutionize collaborative problem-solving,
creative exploration, and social support. To realize this goal, the development of automated …

Many approaches to Natural Language Processing (NLP) tasks often treat them as single-
step problems, where an agent receives an instruction, executes it, and is evaluated based …

We present a rich, multimodal dataset consisting of data from 40 teams of three humans
conducting simulated urban search-and-rescue (SAR) missions in a Minecraft-based …

Language-guided robots must be able to both ask humans questions and understand
answers. Much existing work focuses only on the latter. In this paper, we go beyond …

Human intelligence has the remarkable ability to adapt to new tasks and environments
quickly. Starting from a very young age, humans acquire new skills and learn how to solve …

Abstract Non-Player Characters (NPCs) significantly enhance the player experience in many
games. Historically, players' interactions with NPCs have tended to be highly scripted, to be …

Due in part to its flexibility and open design, the video game Minecraft has emerged as a
popular tool for teaching and learning. Inspired by prior research showing the influence of …