Metadrive: Composing diverse driving scenarios for generalizable reinforcement learning

Q Li, Z Peng, L Feng, Q Zhang, Z Xue… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
Driving safely requires multiple capabilities from human and intelligent agents, such as the
generalizability to unseen environments, the safety awareness of the surrounding traffic, and …

Trafficgen: Learning to generate diverse and realistic traffic scenarios

L Feng, Q Li, Z Peng, S Tan… - 2023 IEEE International …, 2023 - ieeexplore.ieee.org
Diverse and realistic traffic scenarios are crucial for evaluating the AI safety of autonomous
driving systems in simulation. This work introduces a data-driven method called TrafficGen …

Foundation models in robotics: Applications, challenges, and the future

R Firoozi, J Tucker, S Tian, A Majumdar, J Sun… - arXiv preprint arXiv …, 2023 - arxiv.org
We survey applications of pretrained foundation models in robotics. Traditional deep
learning models in robotics are trained on small datasets tailored for specific tasks, which …

Conformal prediction for uncertainty-aware planning with diffusion dynamics model

J Sun, Y Jiang, J Qiu, P Nobel… - Advances in …, 2024 - proceedings.neurips.cc
Robotic applications often involve working in environments that are uncertain, dynamic, and
partially observable. Recently, diffusion models have been proposed for learning trajectory …

A survey of reasoning with foundation models

J Sun, C Zheng, E Xie, Z Liu, R Chu, J Qiu, J Xu… - arXiv preprint arXiv …, 2023 - arxiv.org
Reasoning, a crucial ability for complex problem-solving, plays a pivotal role in various real-
world settings such as negotiation, medical diagnosis, and criminal investigation. It serves …

Plate: Visually-grounded planning with transformers in procedural tasks

J Sun, DA Huang, B Lu, YH Liu… - IEEE Robotics and …, 2022 - ieeexplore.ieee.org
In this work, we study the problem of how to leverage instructional videos to facilitate the
understanding of human decision-making processes, focusing on training a model with the …

Efficient learning of safe driving policy via human-ai copilot optimization

Q Li, Z Peng, B Zhou - arXiv preprint arXiv:2202.10341, 2022 - arxiv.org
Human intervention is an effective way to inject human knowledge into the training loop of
reinforcement learning, which can bring fast learning and ensured training safety. Given the …

Safe driving via expert guided policy optimization

Z Peng, Q Li, C Liu, B Zhou - Conference on Robot Learning, 2022 - proceedings.mlr.press
When learning common skills like driving, beginners usually have domain experts standing
by to ensure the safety of the learning process. We formulate such learning scheme under …

Neuro-symbolic program search for autonomous driving decision module design

J Sun, H Sun, T Han, B Zhou - Conference on Robot …, 2021 - proceedings.mlr.press
As a promising topic in cognitive robotics, neuro-symbolic modeling integrates symbolic
reasoning and neural representation altogether. However, previous neuro-symbolic models …

[HTML][HTML] Visually-guided motion planning for autonomous driving from interactive demonstrations

R Pérez-Dattari, B Brito, O de Groot, J Kober… - … Applications of Artificial …, 2022 - Elsevier
The successful integration of autonomous robots in real-world environments strongly
depends on their ability to reason from context and take socially acceptable actions. Current …