General in-hand object rotation with vision and touch

H Qi, B Yi, S Suresh, M Lambeta, Y Ma… - … on Robot Learning, 2023 - proceedings.mlr.press
We introduce Rotateit, a system that enables fingertip-based object rotation along multiple
axes by leveraging multimodal sensory inputs. Our system is trained in simulation, where it …

Visual-tactile learning of garment unfolding for robot-assisted dressing

F Zhang, Y Demiris - IEEE Robotics and Automation Letters, 2023 - ieeexplore.ieee.org
Assistive robots have the potential to support disabled and elderly people in daily dressing
activities. An intermediate stage of dressing is to manipulate the garment from a crumpled …

A comprehensive review of robot intelligent grasping based on tactile perception

T Li, Y Yan, C Yu, J An, Y Wang, G Chen - Robotics and Computer …, 2024 - Elsevier
The Advancements in tactile sensors and machine learning techniques open new
opportunities for achieving intelligent grasping in robotics. Traditional robot is limited in its …

Gelsight svelte: A human finger-shaped single-camera tactile robot finger with large sensing coverage and proprioceptive sensing

J Zhao, EH Adelson - … on Intelligent Robots and Systems (IROS …, 2023 - ieeexplore.ieee.org
Camera-based tactile sensing is a low-cost, popular approach to obtain highly detailed
contact geometry information. However, most existing camera-based tactile sensors are …

3D-ViTac: Learning Fine-Grained Manipulation with Visuo-Tactile Sensing

B Huang, Y Wang, X Yang, Y Luo, Y Li - arXiv preprint arXiv:2410.24091, 2024 - arxiv.org
Tactile and visual perception are both crucial for humans to perform fine-grained interactions
with their environment. Developing similar multi-modal sensing capabilities for robots can …

Sculptbot: Pre-trained models for 3d deformable object manipulation

A Bartsch, C Avra, AB Farimani - 2024 IEEE International …, 2024 - ieeexplore.ieee.org
Deformable object manipulation presents a unique set of challenges in robotic manipulation
by exhibiting high degrees of freedom and severe self-occlusion. Choosing state …

Self-supervised visuo-tactile pretraining to locate and follow garment features

J Kerr, H Huang, A Wilcox, R Hoque… - arXiv preprint arXiv …, 2022 - arxiv.org
Humans make extensive use of vision and touch as complementary senses, with vision
providing global information about the scene and touch measuring local information during …

TEXterity: Tactile Extrinsic deXterity

A Bronars, S Kim, P Patre… - 2024 IEEE International …, 2024 - ieeexplore.ieee.org
We introduce a novel approach that combines tactile estimation and control for in-hand
object manipulation. By integrating measurements from robot kinematics and an image …

UniGarmentManip: A Unified Framework for Category-Level Garment Manipulation via Dense Visual Correspondence

R Wu, H Lu, Y Wang, Y Wang… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Garment manipulation (eg unfolding folding and hanging clothes) is essential for future
robots to accomplish home-assistant tasks while highly challenging due to the diversity of …

Rainbowsight: A family of generalizable, curved, camera-based tactile sensors for shape reconstruction

MH Tippur, EH Adelson - 2024 IEEE International Conference …, 2024 - ieeexplore.ieee.org
Camera-based tactile sensors can provide high resolution positional and local geometry
information for robotic manipulation. Curved and rounded fingers are often advantageous …