Unlocking Robotic Autonomy: A Survey on the Applications of Foundation Models

DS Jang, DH Cho, WC Lee, SK Ryu, B Jeong… - International Journal of …, 2024 - Springer
The advancement of foundation models, such as large language models (LLMs), vision-
language models (VLMs), diffusion models, and robotics foundation models (RFMs), has …

Semantic Skill Grounding for Embodied Instruction-Following in Cross-Domain Environments

S Shin, S Kim, Y Jang, M Lee, H Woo - arXiv preprint arXiv:2408.01024, 2024 - arxiv.org
In embodied instruction-following (EIF), the integration of pretrained language models (LMs)
as task planners emerges as a significant branch, where tasks are planned at the skill level …

Robi Butler: Remote Multimodal Interactions with Household Robot Assistant

A Xiao, N Janaka, T Hu, A Gupta, K Li, C Yu… - arXiv preprint arXiv …, 2024 - arxiv.org
In this paper, we introduce Robi Butler, a novel household robotic system that enables
multimodal interactions with remote users. Building on the advanced communication …

GSON: A Group-based Social Navigation Framework with Large Multimodal Model

S Luo, J Zhu, P Sun, Y Deng, C Yu, A Xiao… - arXiv preprint arXiv …, 2024 - arxiv.org
As the number of service robots and autonomous vehicles in human-centered environments
grows, their requirements go beyond simply navigating to a destination. They must also take …

LLM as BT-Planner: Leveraging LLMs for Behavior Tree Generation in Robot Task Planning

J Ao, F Wu, Y Wu, A Swikir, S Haddadin - arXiv preprint arXiv:2409.10444, 2024 - arxiv.org
Robotic assembly tasks are open challenges due to the long task horizon and complex part
relations. Behavior trees (BTs) are increasingly used in robot task planning for their …

Robi Butler: Multimodal Remote Interaction with Household Robotic Assistants

A Xiao, A Gupta, Y Deng, K Li, D Hsu - 2nd Workshop on Mobile … - openreview.net
In this paper, we introduce Robi Butler, a novel household robotic system that enables
multimodal interaction with the user. Leveraging advanced communication interfaces, Robi …