Binding touch to everything: Learning unified multimodal tactile representations

F Yang, C Feng, Z Chen, H Park… - Proceedings of the …, 2024 - openaccess.thecvf.com
The ability to associate touch with other modalities has huge implications for humans and
computational systems. However multimodal learning with touch remains challenging due to …

NeuralFeels with neural fields: Visuotactile perception for in-hand manipulation

S Suresh, H Qi, T Wu, T Fan, L Pineda, M Lambeta… - Science Robotics, 2024 - science.org
To achieve human-level dexterity, robots must infer spatial awareness from multimodal
sensing to reason over contact interactions. During in-hand manipulation of novel objects …

Robot synesthesia: In-hand manipulation with visuotactile sensing

Y Yuan, H Che, Y Qin, B Huang, ZH Yin… - … on Robotics and …, 2024 - ieeexplore.ieee.org
Executing contact-rich manipulation tasks necessitates the fusion of tactile and visual
feedback. However, the distinct nature of these modalities poses significant challenges. In …

Rotating without seeing: Towards in-hand dexterity through touch

ZH Yin, B Huang, Y Qin, Q Chen, X Wang - arXiv preprint arXiv …, 2023 - arxiv.org
Tactile information plays a critical role in human dexterity. It reveals useful contact
information that may not be inferred directly from vision. In fact, humans can even perform in …

Touch-gs: Visual-tactile supervised 3d gaussian splatting

A Swann, M Strong, WK Do, GS Camps… - 2024 IEEE/RSJ …, 2024 - ieeexplore.ieee.org
In this work, we propose a novel method to supervise 3D Gaussian Splatting (3DGS) scenes
using optical tactile sensors. Optical tactile sensors have become widespread in their use in …

Haptic exploration of unknown objects for robust in-hand manipulation

G Solak, L Jamone - IEEE Transactions on Haptics, 2023 - ieeexplore.ieee.org
Human-like robot hands provide the flexibility to manipulate a variety of objects that are
found in unstructured environments. Knowledge of object properties and motion trajectory is …

TEXterity: Tactile Extrinsic deXterity

A Bronars, S Kim, P Patre… - 2024 IEEE International …, 2024 - ieeexplore.ieee.org
We introduce a novel approach that combines tactile estimation and control for in-hand
object manipulation. By integrating measurements from robot kinematics and an image …

Sliding touch-based exploration for modeling unknown object shape with multi-fingered hands

Y Chen, AE Tekden, MP Deisenroth… - 2023 IEEE/RSJ …, 2023 - ieeexplore.ieee.org
Efficient and accurate 3D object shape reconstruction contributes significantly to the success
of a robot's physical interaction with its environment. Acquiring accurate shape information …

High-precision 3d reconstruction study with emphasis on refractive calibration of gelstereo-type sensors

C Zhang, S Cui, S Wang, J Hu, Y Huangfu, B Zhang - Sensors, 2023 - mdpi.com
GelStereo sensing technology is capable of performing three-dimensional (3D) contact
shape measurement under various contact structures such as bionic curved surfaces, which …

TEXterity--Tactile Extrinsic deXterity: Simultaneous Tactile Estimation and Control for Extrinsic Dexterity

S Kim, A Bronars, P Patre, A Rodriguez - arXiv preprint arXiv:2403.00049, 2024 - arxiv.org
We introduce a novel approach that combines tactile estimation and control for in-hand
object manipulation. By integrating measurements from robot kinematics and an image …