Applications of knowledge distillation in remote sensing: A survey

Y Himeur, N Aburaed, O Elharrouss, I Varlamis… - Information …, 2024 - Elsevier
With the ever-growing complexity of models in the field of remote sensing (RS), there is an
increasing demand for solutions that balance model accuracy with computational efficiency …

A Review of Federated Learning Methods in Heterogeneous scenarios

J Pei, W Liu, J Li, L Wang, C Liu - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Federated learning emerges as a solution to the dilemma of data silos while safeguarding
data privacy, particularly relevant in the consumer electronics sector where user data privacy …

Knowledge distillation for federated learning: a practical guide

A Mora, I Tenison, P Bellavista, I Rish - arXiv preprint arXiv:2211.04742, 2022 - arxiv.org
Federated Learning (FL) enables the training of Deep Learning models without centrally
collecting possibly sensitive raw data. This paves the way for stronger privacy guarantees …

Fedcache: A knowledge cache-driven federated learning architecture for personalized edge intelligence

Z Wu, S Sun, Y Wang, M Liu, K Xu… - IEEE Transactions …, 2024 - ieeexplore.ieee.org
Edge Intelligence (EI) allows Artificial Intelligence (AI) applications to run at the edge, where
data analysis and decision-making can be performed in real-time and close to data sources …

Fedict: Federated multi-task distillation for multi-access edge computing

Z Wu, S Sun, Y Wang, M Liu, Q Pan… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
The growing interest in intelligent services and privacy protection for mobile devices has
given rise to the widespread application of federated learning in Multi-access Edge …

Agglomerative federated learning: Empowering larger model training via end-edge-cloud collaboration

Z Wu, S Sun, Y Wang, M Liu, B Gao… - … -IEEE Conference on …, 2024 - ieeexplore.ieee.org
Federated Learning (FL) enables training Artificial Intelligence (AI) models over end devices
without compromising their privacy. As computing tasks are increasingly performed by a …

[PDF][PDF] Survey of knowledge distillation in federated edge learning

Z Wu, S Sun, Y Wang, M Liu, X Jiang… - arXiv preprint arXiv …, 2023 - researchgate.net
The increasing demand for intelligent services and privacy protection of mobile and Internet
of Things (IoT) devices motivates the wide application of Federated Edge Learning (FEL), in …

FedDyn: A dynamic and efficient federated distillation approach on Recommender System

C Jin, X Chen, Y Gu, Q Li - 2022 IEEE 28th international …, 2023 - ieeexplore.ieee.org
Federated Learning (FL) is a popular distributed machine learning paradigm that enables
devices to work together to train a centralized model without transmitting raw data. However …

Towards consensual representation: Model-agnostic knowledge extraction for dual heterogeneous federated fault diagnosis

J Wang, P Song, C Zhao - Neural Networks, 2024 - Elsevier
Federated fault diagnosis has attracted increasing attention in industrial cloud–edge
collaboration scenarios, where a ubiquitous assumption is that client models have the same …

Federated skewed label learning with logits fusion

Y Wang, R Li, H Tan, X Jiang, S Sun, M Liu… - arXiv preprint arXiv …, 2023 - arxiv.org
Federated learning (FL) aims to collaboratively train a shared model across multiple clients
without transmitting their local data. Data heterogeneity is a critical challenge in realistic FL …