On the use of simulation in robotics: Opportunities, challenges, and suggestions for moving forward

HS Choi, C Crump, C Duriez… - Proceedings of the …, 2021 - National Acad Sciences
The last five years marked a surge in interest for and use of smart robots, which operate in
dynamic and unstructured environments and might interact with humans. We posit that well …

Optimization-based control for dynamic legged robots

PM Wensing, M Posa, Y Hu, A Escande… - IEEE Transactions …, 2023 - ieeexplore.ieee.org
In a world designed for legs, quadrupeds, bipeds, and humanoids have the opportunity to
impact emerging robotics applications from logistics, to agriculture, to home assistance. The …

Making sense of vision and touch: Self-supervised learning of multimodal representations for contact-rich tasks

MA Lee, Y Zhu, K Srinivasan, P Shah… - … on robotics and …, 2019 - ieeexplore.ieee.org
Contact-rich manipulation tasks in unstructured environments often require both haptic and
visual feedback. However, it is non-trivial to manually design a robot controller that …

Making sense of vision and touch: Learning multimodal representations for contact-rich tasks

MA Lee, Y Zhu, P Zachares, M Tan… - IEEE Transactions …, 2020 - ieeexplore.ieee.org
Contact-rich manipulation tasks in unstructured environments often require both haptic and
visual feedback. It is nontrivial to manually design a robot controller that combines these …

Propagation networks for model-based control under partial observation

Y Li, J Wu, JY Zhu, JB Tenenbaum… - … on Robotics and …, 2019 - ieeexplore.ieee.org
There has been an increasing interest in learning dynamics simulators for model-based
control. Compared with off-the-shelf physics engines, a learnable simulator can quickly …

Augmenting physical simulators with stochastic neural networks: Case study of planar pushing and bouncing

A Ajay, J Wu, N Fazeli, M Bauza… - 2018 IEEE/RSJ …, 2018 - ieeexplore.ieee.org
An efficient, generalizable physical simulator with universal uncertainty estimates has wide
applications in robot state estimation, planning, and control. In this paper, we build such a …

See, feel, act: Hierarchical learning for complex manipulation skills with multisensory fusion

N Fazeli, M Oller, J Wu, Z Wu, JB Tenenbaum… - Science Robotics, 2019 - science.org
Humans are able to seamlessly integrate tactile and visual stimuli with their intuitions to
explore and execute complex manipulation skills. They not only see but also feel their …

Combining physical simulators and object-based networks for control

A Ajay, M Bauza, J Wu, N Fazeli… - … on Robotics and …, 2019 - ieeexplore.ieee.org
Physics engines play an important role in robot planning and control; however, many real-
world control problems involve complex contact dynamics that cannot be characterized …

Impact invariant control with applications to bipedal locomotion

W Yang, M Posa - 2021 IEEE/RSJ International Conference on …, 2021 - ieeexplore.ieee.org
When legged robots impact their environment, they undergo large changes in their velocities
in a small amount of time. Measuring and applying feedback to these velocities is …

Learning the dynamics of compliant tool-environment interaction for visuo-tactile contact servoing

M Van der Merwe, D Berenson… - Conference on Robot …, 2023 - proceedings.mlr.press
Many manipulation tasks require the robot to control the contact between a grasped
compliant tool and the environment, eg scraping a frying pan with a spatula. However …