Generalized federated learning via sharpness aware minimization
Federated Learning (FL) is a promising framework for performing privacy-preserving,
distributed learning with a set of clients. However, the data distribution among clients often …
distributed learning with a set of clients. However, the data distribution among clients often …
Faster adaptive federated learning
Federated learning has attracted increasing attention with the emergence of distributed data.
While extensive federated learning algorithms have been proposed for the non-convex …
While extensive federated learning algorithms have been proposed for the non-convex …
Solving a class of non-convex minimax optimization in federated learning
The minimax problems arise throughout machine learning applications, ranging from
adversarial training and policy evaluation in reinforcement learning to AUROC …
adversarial training and policy evaluation in reinforcement learning to AUROC …
Accelerated federated learning with decoupled adaptive optimization
The federated learning (FL) framework enables edge clients to collaboratively learn a
shared inference model while keeping privacy of training data on clients. Recently, many …
shared inference model while keeping privacy of training data on clients. Recently, many …
On convergence of FedProx: Local dissimilarity invariant bounds, non-smoothness and beyond
The\FedProx~ algorithm is a simple yet powerful distributed proximal point optimization
method widely used for federated learning (FL) over heterogeneous data. Despite its …
method widely used for federated learning (FL) over heterogeneous data. Despite its …
Federated conditional stochastic optimization
Conditional stochastic optimization has found applications in a wide range of machine
learning tasks, such as invariant learning, AUPRC maximization, and meta-learning. As the …
learning tasks, such as invariant learning, AUPRC maximization, and meta-learning. As the …
Fedvarp: Tackling the variance due to partial client participation in federated learning
D Jhunjhunwala, P Sharma… - Uncertainty in …, 2022 - proceedings.mlr.press
Data-heterogeneous federated learning (FL) systems suffer from two significant sources of
convergence error: 1) client drift error caused by performing multiple local optimization steps …
convergence error: 1) client drift error caused by performing multiple local optimization steps …
Fedgamma: Federated learning with global sharpness-aware minimization
Federated learning (FL) is a promising framework for privacy-preserving and distributed
training with decentralized clients. However, there exists a large divergence between the …
training with decentralized clients. However, there exists a large divergence between the …
Towards optimal communication complexity in distributed non-convex optimization
We study the problem of distributed stochastic non-convex optimization with intermittent
communication. We consider the full participation setting where $ M $ machines work in …
communication. We consider the full participation setting where $ M $ machines work in …
SAGDA: Achieving Communication Complexity in Federated Min-Max Learning
Federated min-max learning has received increasing attention in recent years thanks to its
wide range of applications in various learning paradigms. Similar to the conventional …
wide range of applications in various learning paradigms. Similar to the conventional …