A vision-based tactile sensor (VBTS) is an innovative optical sensor widely applied in robotic
perception. The VBTS consists of a contact module, an illumination module, and a camera …

Many computer vision techniques infer properties of our physical world from images.
Although images are formed through the physics of light and mechanics, computer vision …

The ability to associate touch with other modalities has huge implications for humans and
computational systems. However multimodal learning with touch remains challenging due to …

We present a retrospective on the state of Embodied AI research. Our analysis focuses on
13 challenges presented at the Embodied AI Workshop at CVPR. These challenges are …

Simulation is widely used in robotics for system verification and large-scale data collection.
However, simulating sensors, including tactile sensors, has been a long-standing challenge …

Flesh encodes a variety of haptic information including deformation, temperature, vibration,
and damage stimuli using a multisensory array of mechanoreceptors distributed on the …

Large-scale robotic skin with tactile sensing ability is emerging with the potential for use in
close-contact human–robot systems. Although recent developments in vision-based tactile …

Tactile perception is key for robotics applications such as manipulation. However, tactile
data collection is time-consuming, especially when compared to vision. This limits the use of …

Simulation is widely applied in robotics research to save time and resources. There have
been several works to simulate optical tactile sensors that leverage either a smoothing …

We present MidasTouch, a tactile perception system for online global localization of a vision-
based touch sensor sliding on an object surface. This framework takes in posed tactile …