Generalized federated learning via sharpness aware minimization

Z Qu, X Li, R Duan, Y Liu, B Tang… - … conference on machine …, 2022 - proceedings.mlr.press
Federated Learning (FL) is a promising framework for performing privacy-preserving,
distributed learning with a set of clients. However, the data distribution among clients often …

Faster adaptive federated learning

X Wu, F Huang, Z Hu, H Huang - … of the AAAI conference on artificial …, 2023 - ojs.aaai.org
Federated learning has attracted increasing attention with the emergence of distributed data.
While extensive federated learning algorithms have been proposed for the non-convex …

Solving a class of non-convex minimax optimization in federated learning

X Wu, J Sun, Z Hu, A Zhang… - Advances in Neural …, 2024 - proceedings.neurips.cc
The minimax problems arise throughout machine learning applications, ranging from
adversarial training and policy evaluation in reinforcement learning to AUROC …

Accelerated federated learning with decoupled adaptive optimization

J Jin, J Ren, Y Zhou, L Lyu, J Liu… - … on Machine Learning, 2022 - proceedings.mlr.press
The federated learning (FL) framework enables edge clients to collaboratively learn a
shared inference model while keeping privacy of training data on clients. Recently, many …

On convergence of FedProx: Local dissimilarity invariant bounds, non-smoothness and beyond

X Yuan, P Li - Advances in Neural Information Processing …, 2022 - proceedings.neurips.cc
The\FedProx~ algorithm is a simple yet powerful distributed proximal point optimization
method widely used for federated learning (FL) over heterogeneous data. Despite its …

Federated conditional stochastic optimization

X Wu, J Sun, Z Hu, J Li, A Zhang… - Advances in Neural …, 2024 - proceedings.neurips.cc
Conditional stochastic optimization has found applications in a wide range of machine
learning tasks, such as invariant learning, AUPRC maximization, and meta-learning. As the …

Fedvarp: Tackling the variance due to partial client participation in federated learning

D Jhunjhunwala, P Sharma… - Uncertainty in …, 2022 - proceedings.mlr.press
Data-heterogeneous federated learning (FL) systems suffer from two significant sources of
convergence error: 1) client drift error caused by performing multiple local optimization steps …

Fedgamma: Federated learning with global sharpness-aware minimization

R Dai, X Yang, Y Sun, L Shen, X Tian… - … on Neural Networks …, 2023 - ieeexplore.ieee.org
Federated learning (FL) is a promising framework for privacy-preserving and distributed
training with decentralized clients. However, there exists a large divergence between the …

Towards optimal communication complexity in distributed non-convex optimization

KK Patel, L Wang, BE Woodworth… - Advances in Neural …, 2022 - proceedings.neurips.cc
We study the problem of distributed stochastic non-convex optimization with intermittent
communication. We consider the full participation setting where $ M $ machines work in …

SAGDA: Achieving Communication Complexity in Federated Min-Max Learning

H Yang, Z Liu, X Zhang, J Liu - Advances in Neural …, 2022 - proceedings.neurips.cc
Federated min-max learning has received increasing attention in recent years thanks to its
wide range of applications in various learning paradigms. Similar to the conventional …