To interact with humans in the world, agents need to understand the diverse types of
language that people use, relate them to the visual world, and act based on them. While …

Interactive Natural Language Processing (iNLP) has emerged as a novel paradigm within
the field of NLP, aimed at addressing limitations in existing frameworks while aligning with …

Theory of Mind (ToM) $\unicode {x2014} $ the ability to reason about the mental states of
other people $\unicode {x2014} $ is a key element of our social intelligence. Yet, despite …

" Thinking is for Doing." Humans can infer other people's mental states from observations--
an ability called Theory-of-Mind (ToM)--and subsequently act pragmatically on those …

Despite their tremendous success in many applications, large language models often fall
short of consistent reasoning and planning in various (language, embodied, and social) …

Large Language Models (LLMs) have generated considerable interest and debate
regarding their potential emergence of Theory of Mind (ToM). Several recent inquiries reveal …

We propose CX-ToM, short for counterfactual explanations with theory-of-mind, a new
explainable AI (XAI) framework for explaining decisions made by a deep convolutional …

Dialogue-based human-AI collaboration can revolutionize collaborative problem-solving,
creative exploration, and social support. To realize this goal, the development of automated …

Effective conversation requires common ground: a shared understanding between the
participants. Common ground, however, does not emerge spontaneously in conversation …

We propose a novel task, G4C, to study teacher-student natural language interactions in a
goal-driven and grounded environment. Dungeons and Dragons (D&D), a role-playing …