Foundations & trends in multimodal machine learning: Principles, challenges, and open questions

PP Liang, A Zadeh, LP Morency - ACM Computing Surveys, 2024 - dl.acm.org
Multimodal machine learning is a vibrant multi-disciplinary research field that aims to design
computer agents with intelligent capabilities such as understanding, reasoning, and learning …

A comparative review on multi-modal sensors fusion based on deep learning

Q Tang, J Liang, F Zhu - Signal Processing, 2023 - Elsevier
The wide deployment of multi-modal sensors in various areas generates vast amounts of
data with characteristics of high volume, wide variety, and high integrity. However, traditional …

[HTML][HTML] Adaptive tactile interaction transfer via digitally embroidered smart gloves

Y Luo, C Liu, YJ Lee, J DelPreto, K Wu… - Nature …, 2024 - nature.com
Human-machine interfaces for capturing, conveying, and sharing tactile information across
time and space hold immense potential for healthcare, augmented and virtual reality, human …

Representation in AI evaluations

AS Bergman, LA Hendricks, M Rauh, B Wu… - Proceedings of the …, 2023 - dl.acm.org
Calls for representation in artificial intelligence (AI) and machine learning (ML) are
widespread, with" representation" or" representativeness" generally understood to be both …

[HTML][HTML] MultiSenseBadminton: Wearable Sensor–Based Biomechanical Dataset for Evaluation of Badminton Performance

M Seong, G Kim, D Yeo, Y Kang, H Yang, J DelPreto… - Scientific Data, 2024 - nature.com
The sports industry is witnessing an increasing trend of utilizing multiple synchronized
sensors for player data collection, enabling personalized training systems with multi …

[HTML][HTML] Tactile-sensing technologies: Trends, challenges and outlook in agri-food manipulation

W Mandil, V Rajendran, K Nazari… - Sensors, 2023 - mdpi.com
Tactile sensing plays a pivotal role in achieving precise physical manipulation tasks and
extracting vital physical features. This comprehensive review paper presents an in-depth …

Fedmfs: Federated multimodal fusion learning with selective modality communication

L Yuan, DJ Han, VP Chellapandi, SH Żak… - arXiv preprint arXiv …, 2023 - arxiv.org
Federated learning (FL) is a distributed machine learning (ML) paradigm that enables clients
to collaborate without accessing, infringing upon, or leaking original user data by sharing …

[HTML][HTML] Electronic Skin: Opportunities and Challenges in Convergence with Machine Learning

JH Koo, YJ Lee, HJ Kim, W Matusik… - Annual Review of …, 2024 - annualreviews.org
Recent advancements in soft electronic skin (e-skin) have led to the development of human-
like devices that reproduce the skin's functions and physical attributes. These devices are …

Robochop: Autonomous framework for fruit and vegetable chopping leveraging foundational models

A Dikshit, A Bartsch, A George, AB Farimani - arXiv preprint arXiv …, 2023 - arxiv.org
With the goal of developing fully autonomous cooking robots, developing robust systems
that can chop a wide variety of objects is important. Existing approaches focus primarily on …

MANUS: Markerless Grasp Capture using Articulated 3D Gaussians

C Pokhariya, IN Shah, A Xing, Z Li… - Proceedings of the …, 2024 - openaccess.thecvf.com
Understanding how we grasp objects with our hands has important applications in areas like
robotics and mixed reality. However this challenging problem requires accurate modeling of …