Binding touch to everything: Learning unified multimodal tactile representations

F Yang, C Feng, Z Chen, H Park… - Proceedings of the …, 2024 - openaccess.thecvf.com
The ability to associate touch with other modalities has huge implications for humans and
computational systems. However multimodal learning with touch remains challenging due to …

Robot synesthesia: In-hand manipulation with visuotactile sensing

Y Yuan, H Che, Y Qin, B Huang, ZH Yin… - … on Robotics and …, 2024 - ieeexplore.ieee.org
Executing contact-rich manipulation tasks necessitates the fusion of tactile and visual
feedback. However, the distinct nature of these modalities poses significant challenges. In …

TEXterity: Tactile Extrinsic deXterity

A Bronars, S Kim, P Patre… - 2024 IEEE International …, 2024 - ieeexplore.ieee.org
We introduce a novel approach that combines tactile estimation and control for in-hand
object manipulation. By integrating measurements from robot kinematics and an image …

TEXterity--Tactile Extrinsic deXterity: Simultaneous Tactile Estimation and Control for Extrinsic Dexterity

S Kim, A Bronars, P Patre, A Rodriguez - arXiv preprint arXiv:2403.00049, 2024 - arxiv.org
We introduce a novel approach that combines tactile estimation and control for in-hand
object manipulation. By integrating measurements from robot kinematics and an image …

[HTML][HTML] Bridging vision and touch: advancing robotic interaction prediction with self-supervised multimodal learning

L Li, TG Thuruthel - Frontiers in Robotics and AI, 2024 - frontiersin.org
Predicting the consequences of the agent's actions on its environment is a pivotal challenge
in robotic learning, which plays a key role in developing higher cognitive skills for intelligent …

Learning-Based Planner for Unknown Object Dexterous Manipulation Using ANFIS

M Sheikhsamad, R Suárez, J Rosell - Machines, 2024 - mdpi.com
Dexterous manipulation of unknown objects performed by robots equipped with mechanical
hands represents a critical challenge. The difficulties arise from the absence of a precise …

Simultaneous Tactile Estimation and Control for Extrinsic Dexterity

A Bronars, S Kim, P Patre, A Rodriguez - arXiv preprint arXiv:2401.10230, 2024 - arxiv.org
We introduce a novel approach that combines tactile estimation and control for in-hand
object manipulation. By integrating measurements from robot kinematics and an image …

DTactive: A Vision-Based Tactile Sensor with Active Surface

J Xu, L Wu, C Lin, D Zhao, H Xu - arXiv preprint arXiv:2410.08337, 2024 - arxiv.org
The development of vision-based tactile sensors has significantly enhanced robots'
perception and manipulation capabilities, especially for tasks requiring contact-rich …

TEXterity: Tactile Extrinsic deXterity

S Kim - 2024 - dspace.mit.edu
This thesis introduces the concept of TEXterity (Tactile Extrinsic deXterity) to address
challenges in robotic manipulation. Focusing on tactile sensing, TEXterity aims to enhance …