[HTML][HTML] Federated learning for IoT devices: Enhancing TinyML with on-board training

M Ficco, A Guerriero, E Milite, F Palmieri… - Information …, 2024 - Elsevier
The spread of the Internet of Things (IoT) involving an uncountable number of applications,
combined with the rise of Machine Learning (ML), has enabled the rapid growth of pervasive …

Structured Sparse Back-propagation for Lightweight On-Device Continual Learning on Microcontroller Units

F Paissan, D Nadalini, M Rusci… - Proceedings of the …, 2024 - openaccess.thecvf.com
With many devices deployed at the extreme edge in dynamic environments the ability to
learn continually on the device is a fast-emerging trend for ultra-low-power Microcontrollers …

Towards Green AI in Fine-tuning Large Language Models via Adaptive Backpropagation

K Huang, H Yin, H Huang, W Gao - arXiv preprint arXiv:2309.13192, 2023 - arxiv.org
Fine-tuning is the most effective way of adapting pre-trained large language models (LLMs)
to downstream applications. With the fast growth of LLM-enabled AI applications and …

LifeLearner: Hardware-Aware Meta Continual Learning System for Embedded Computing Platforms

YD Kwon, J Chauhan, H Jia, SI Venieris… - Proceedings of the 21st …, 2023 - dl.acm.org
Continual Learning (CL) allows applications such as user personalization and household
robots to learn on the fly and adapt to context. This is an important feature when context …

MicroT: Low-Energy and Adaptive Models for MCUs

Y Huang, R Aloufi, X Cadet, Y Zhao, P Barnaghi… - arXiv preprint arXiv …, 2024 - arxiv.org
We propose MicroT, a low-energy, multi-task adaptive model framework for resource-
constrained MCUs. We divide the original model into a feature extractor and a classifier. The …

Towards On-device Learning on the Edge: Ways to Select Neurons to Update under a Budget Constraint

A Quélennec, E Tartaglione… - Proceedings of the …, 2024 - openaccess.thecvf.com
In the realm of efficient on-device learning under extreme memory and computation
constraints, a significant gap in successful approaches persists. Although a considerable …

Towards Low-Energy Adaptive Personalization for Resource-Constrained Devices

Y Huang, J Millar, Y Long, Y Zhao… - Proceedings of the 4th …, 2024 - dl.acm.org
The personalization of machine learning (ML) models to address data drift is a significant
challenge in the context of Internet of Things (IoT) applications. Presently, most approaches …

On-Device Training Empowered Transfer Learning For Human Activity Recognition

P Kang, J Moosmann, S Bian, M Magno - arXiv preprint arXiv:2407.03644, 2024 - arxiv.org
Human Activity Recognition (HAR) is an attractive topic to perceive human behavior and
supplying assistive services. Besides the classical inertial unit and vision-based HAR …

On-device Self-supervised Learning of Visual Perception Tasks aboard Hardware-limited Nano-quadrotors

E Cereda, M Rusci, A Giusti, D Palossi - arXiv preprint arXiv:2403.04071, 2024 - arxiv.org
Sub-\SI {50}{\gram} nano-drones are gaining momentum in both academia and industry.
Their most compelling applications rely on onboard deep learning models for perception …

Training on the Fly: On-device Self-supervised Learning aboard Nano-drones within 20 mW

E Cereda, A Giusti, D Palossi - arXiv preprint arXiv:2408.03168, 2024 - arxiv.org
Miniaturized cyber-physical systems (CPSes) powered by tiny machine learning (TinyML),
such as nano-drones, are becoming an increasingly attractive technology. Their small form …