When foundation model meets federated learning: Motivations, challenges, and future directions

W Zhuang, C Chen, L Lyu - arXiv preprint arXiv:2306.15546, 2023 - arxiv.org
The intersection of the Foundation Model (FM) and Federated Learning (FL) provides mutual
benefits, presents a unique opportunity to unlock new possibilities in AI research, and …

Rethinking the learning paradigm for dynamic facial expression recognition

H Wang, B Li, S Wu, S Shen, F Liu… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Dynamic Facial Expression Recognition (DFER) is a rapidly developing field that
focuses on recognizing facial expressions in video format. Previous research has …

Federated incremental semantic segmentation

J Dong, D Zhang, Y Cong, W Cong… - Proceedings of the …, 2023 - openaccess.thecvf.com
Federated learning-based semantic segmentation (FSS) has drawn widespread attention
via decentralized training on local clients. However, most FSS models assume categories …

Evaluations of machine learning privacy defenses are misleading

M Aerni, J Zhang, F Tramèr - Proceedings of the 2024 on ACM SIGSAC …, 2024 - dl.acm.org
Empirical defenses for machine learning privacy forgo the provable guarantees of
differential privacy in the hope of achieving higher utility while resisting realistic adversaries …

No fear of classifier biases: Neural collapse inspired federated learning with synthetic and fixed classifier

Z Li, X Shang, R He, T Lin… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Data heterogeneity is an inherent challenge that hinders the performance of federated
learning (FL). Recent studies have identified the biased classifiers of local models as the key …

Federated large language models: Current progress and future directions

Y Yao, J Zhang, J Wu, C Huang, Y Xia, T Yu… - arXiv preprint arXiv …, 2024 - arxiv.org
Large language models are rapidly gaining popularity and have been widely adopted in real-
world applications. While the quality of training data is essential, privacy concerns arise …

ADFL: Defending backdoor attacks in federated learning via adversarial distillation

C Zhu, J Zhang, X Sun, B Chen, W Meng - Computers & Security, 2023 - Elsevier
Federated learning enables multi-participant joint modeling with distributed and localized
training, thus effectively overcoming the problems of data island and privacy protection …

Target: Federated class-continual learning via exemplar-free distillation

J Zhang, C Chen, W Zhuang… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
This paper focuses on an under-explored yet important problem: Federated Class-Continual
Learning (FCCL), where new classes are dynamically added in federated learning. Existing …

Transpeech: Speech-to-speech translation with bilateral perturbation

R Huang, J Liu, H Liu, Y Ren, L Zhang, J He… - arXiv preprint arXiv …, 2022 - arxiv.org
Direct speech-to-speech translation (S2ST) with discrete units leverages recent progress in
speech representation learning. Specifically, a sequence of discrete representations derived …

Delving into the adversarial robustness of federated learning

J Zhang, B Li, C Chen, L Lyu, S Wu, S Ding… - Proceedings of the AAAI …, 2023 - ojs.aaai.org
Abstract In Federated Learning (FL), models are as fragile as centrally trained models
against adversarial examples. However, the adversarial robustness of federated learning …