Binding touch to everything: Learning unified multimodal tactile representations
The ability to associate touch with other modalities has huge implications for humans and
computational systems. However multimodal learning with touch remains challenging due to …
computational systems. However multimodal learning with touch remains challenging due to …
NeuralFeels with neural fields: Visuotactile perception for in-hand manipulation
To achieve human-level dexterity, robots must infer spatial awareness from multimodal
sensing to reason over contact interactions. During in-hand manipulation of novel objects …
sensing to reason over contact interactions. During in-hand manipulation of novel objects …
Robot synesthesia: In-hand manipulation with visuotactile sensing
Executing contact-rich manipulation tasks necessitates the fusion of tactile and visual
feedback. However, the distinct nature of these modalities poses significant challenges. In …
feedback. However, the distinct nature of these modalities poses significant challenges. In …
Rotating without seeing: Towards in-hand dexterity through touch
Tactile information plays a critical role in human dexterity. It reveals useful contact
information that may not be inferred directly from vision. In fact, humans can even perform in …
information that may not be inferred directly from vision. In fact, humans can even perform in …
Touch-gs: Visual-tactile supervised 3d gaussian splatting
In this work, we propose a novel method to supervise 3D Gaussian Splatting (3DGS) scenes
using optical tactile sensors. Optical tactile sensors have become widespread in their use in …
using optical tactile sensors. Optical tactile sensors have become widespread in their use in …
Haptic exploration of unknown objects for robust in-hand manipulation
Human-like robot hands provide the flexibility to manipulate a variety of objects that are
found in unstructured environments. Knowledge of object properties and motion trajectory is …
found in unstructured environments. Knowledge of object properties and motion trajectory is …
TEXterity: Tactile Extrinsic deXterity
We introduce a novel approach that combines tactile estimation and control for in-hand
object manipulation. By integrating measurements from robot kinematics and an image …
object manipulation. By integrating measurements from robot kinematics and an image …
Sliding touch-based exploration for modeling unknown object shape with multi-fingered hands
Efficient and accurate 3D object shape reconstruction contributes significantly to the success
of a robot's physical interaction with its environment. Acquiring accurate shape information …
of a robot's physical interaction with its environment. Acquiring accurate shape information …
High-precision 3d reconstruction study with emphasis on refractive calibration of gelstereo-type sensors
GelStereo sensing technology is capable of performing three-dimensional (3D) contact
shape measurement under various contact structures such as bionic curved surfaces, which …
shape measurement under various contact structures such as bionic curved surfaces, which …
TEXterity--Tactile Extrinsic deXterity: Simultaneous Tactile Estimation and Control for Extrinsic Dexterity
We introduce a novel approach that combines tactile estimation and control for in-hand
object manipulation. By integrating measurements from robot kinematics and an image …
object manipulation. By integrating measurements from robot kinematics and an image …