Markerless camera-to-robot pose estimation via self-supervised sim-to-real transfer

J Lu, F Richter, MC Yip - … of the IEEE/CVF Conference on …, 2023 - openaccess.thecvf.com
Solving the camera-to-robot pose is a fundamental requirement for vision-based robot
control, and is a process that takes considerable effort and cares to make accurate …

A systematic review and evaluation of synthetic simulated data generation strategies for deep learning applications in construction

L Xu, H Liu, B Xiao, X Luo, Z Zhu - Advanced Engineering Informatics, 2024 - Elsevier
The integration of deep learning (DL) into construction applications holds substantial
potential for enhancing construction automation and intelligence. However, successful …

Image-based pose estimation and shape reconstruction for robot manipulators and soft, continuum robots via differentiable rendering

J Lu, F Liu, C Girerd, MC Yip - 2023 IEEE International …, 2023 - ieeexplore.ieee.org
State estimation from measured data is crucial for robotic applications as autonomous
systems rely on sensors to capture the motion and localize in the 3D world. Among sensors …

Visual identification of articulated object parts

V Zeng, TE Lee, J Liang… - 2021 IEEE/RSJ …, 2021 - ieeexplore.ieee.org
As autonomous robots interact and navigate around real-world environments such as
homes, it is useful to reliably identify and manipulate articulated objects, such as doors and …

[HTML][HTML] Review of Machine Learning in Robotic Grasping Control in Space Application

H Jahanshahi, ZH Zhu - Acta Astronautica, 2024 - Elsevier
This article presents a comprehensive survey of the integration of machine learning
techniques into robotic grasping, with a special emphasis on the challenges and …

Robotic manipulation of deformable rope-like objects using differentiable compliant position-based dynamics

F Liu, E Su, J Lu, M Li, MC Yip - IEEE Robotics and Automation …, 2023 - ieeexplore.ieee.org
Robot manipulation of rope-like objects is an interesting problem with some critical
applications, such as autonomous robotic suturing. Solving for and controlling rope is …

External camera-based mobile robot pose estimation for collaborative perception with smart edge sensors

S Bultmann, R Memmesheimer… - 2023 IEEE International …, 2023 - ieeexplore.ieee.org
We present an approach for estimating a mobile robot's pose wrt the allocentric coordinates
of a network of static cameras using multi-view RGB images. The images are processed …

Robotic tool tracking under partially visible kinematic chain: A unified approach

F Richter, J Lu, RK Orosco… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Anytime a robot manipulator is controlled via visual feedback, the transformation between
the robot and camera frame must be known. However, in the case where cameras can only …

Robot structure prior guided temporal attention for camera-to-robot pose estimation from image sequence

Y Tian, J Zhang, Z Yin, H Dong - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
In this work, we tackle the problem of online camera-to-robot pose estimation from single-
view successive frames of an image sequence, a crucial task for robots to interact with the …

Easyhec: Accurate and automatic hand-eye calibration via differentiable rendering and space exploration

L Chen, Y Qin, X Zhou, H Su - IEEE Robotics and Automation …, 2023 - ieeexplore.ieee.org
Hand-eye calibration is a critical task in robotics, as it directly affects the efficacy of critical
operations such as manipulation and grasping. Traditional methods for achieving this …