Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions

PP Liang, A Zadeh, LP Morency - arXiv preprint arXiv:2209.03430, 2022 - arxiv.org
Multimodal machine learning is a vibrant multi-disciplinary research field that aims to design
computer agents with intelligent capabilities such as understanding, reasoning, and learning …

Foundations & trends in multimodal machine learning: Principles, challenges, and open questions

PP Liang, A Zadeh, LP Morency - ACM Computing Surveys, 2024 - dl.acm.org
Multimodal machine learning is a vibrant multi-disciplinary research field that aims to design
computer agents with intelligent capabilities such as understanding, reasoning, and learning …

End-to-end autonomous driving: Challenges and frontiers

L Chen, P Wu, K Chitta, B Jaeger… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
The autonomous driving community has witnessed a rapid growth in approaches that
embrace an end-to-end algorithm framework, utilizing raw sensor input to generate vehicle …

A survey on multimodal large language models for autonomous driving

C Cui, Y Ma, X Cao, W Ye, Y Zhou… - Proceedings of the …, 2024 - openaccess.thecvf.com
With the emergence of Large Language Models (LLMs) and Vision Foundation Models
(VFMs), multimodal AI systems benefiting from large models have the potential to equally …

A survey on safety-critical driving scenario generation—A methodological perspective

W Ding, C Xu, M Arief, H Lin, B Li… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Autonomous driving systems have witnessed significant development during the past years
thanks to the advance in machine learning-enabled sensing and decision-making …

Generating useful accident-prone driving scenarios via a learned traffic prior

D Rempe, J Philion, LJ Guibas… - Proceedings of the …, 2022 - openaccess.thecvf.com
Evaluating and improving planning for autonomous vehicles requires scalable generation of
long-tail traffic scenarios. To be useful, these scenarios must be realistic and challenging …

Advdo: Realistic adversarial attacks for trajectory prediction

Y Cao, C Xiao, A Anandkumar, D Xu… - European Conference on …, 2022 - Springer
Trajectory prediction is essential for autonomous vehicles (AVs) to plan correct and safe
driving behaviors. While many prior works aim to achieve higher prediction accuracy, few …

Advsim: Generating safety-critical scenarios for self-driving vehicles

J Wang, A Pun, J Tu, S Manivasagam… - Proceedings of the …, 2021 - openaccess.thecvf.com
As self-driving systems become better, simulating scenarios where the autonomy stack may
fail becomes more important. Traditionally, those scenarios are generated for a few scenes …

King: Generating safety-critical driving scenarios for robust imitation via kinematics gradients

N Hanselmann, K Renz, K Chitta… - … on Computer Vision, 2022 - Springer
Simulators offer the possibility of safe, low-cost development of self-driving systems.
However, current driving simulators exhibit naïve behavior models for background traffic …

Synthetic datasets for autonomous driving: A survey

Z Song, Z He, X Li, Q Ma, R Ming, Z Mao… - IEEE Transactions …, 2023 - ieeexplore.ieee.org
Autonomous driving techniques have been flourishing in recent years while thirsting for
huge amounts of high-quality data. However, it is difficult for real-world datasets to keep up …