We use words to communicate about things and kinds of things, their properties, relations
and actions. Researchers are now creating robotic and simulated systems that ground …

This article offers a survey of computational research on referring expression generation
(REG). It introduces the REG problem and describes early work in this area, discussing what …

One of the main challenges in automatically generating textual weather forecasts is
choosing appropriate English words to communicate numeric weather data. A corpus-based …

A theoretical framework for grounding language is introduced that provides a computational
path from sensing and motor action to words and speech acts. The approach combines …

We propose a system for human-robot interaction that learns both models for spatial
prepositions and for object recognition. Our system grounds the meaning of an input …

Abstract Language is sensitive to both semantic and pragmatic effects. To capture both
effects, we model language use as a cooperative game between two players: a speaker …

The ability to map descriptions of scenes to 3D geometric representations has many
applications in areas such as art, education, and robotics. However, prior work on the text to …

An argument that computational models can shed light on referring, a fundamental and
much-studied aspect of communication. To communicate, speakers need to make it clear …

We introduce GroundNet, a neural network for referring expression recognition---the task of
localizing (or grounding) in an image the object referred to by a natural language …

To what extent do conceptual schemas underlying temporal language correspond to those
of spatial language? This paper addresses this question by providing an overview of …