A Damped Newton Method Achieves Global and Local Quadratic Convergence Rate
S Hanzely, D Kamzolov… - Advances in …, 2022 - proceedings.neurips.cc
In this paper, we present the first stepsize schedule for Newton method resulting in fast
global and local convergence guarantees. In particular, we a) prove an $\mathcal O\left …
global and local convergence guarantees. In particular, we a) prove an $\mathcal O\left …
Towards more suitable personalization in federated learning via decentralized partial model training
Personalized federated learning (PFL) aims to produce the greatest personalized model for
each client to face an insurmountable problem--data heterogeneity in real FL systems …
each client to face an insurmountable problem--data heterogeneity in real FL systems …
Decentralized Directed Collaboration for Personalized Federated Learning
Abstract Personalized Federated Learning (PFL) is proposed to find the greatest
personalized models for each client. To avoid the central failure and communication …
personalized models for each client. To avoid the central failure and communication …
Personalized decentralized federated learning with knowledge distillation
E Jeong, M Kountouris - ICC 2023-IEEE International …, 2023 - ieeexplore.ieee.org
Personalization in federated learning (FL) functions as a coordinator for clients with high
variance in data or behavior. Ensuring the convergence of these clients' models relies on …
variance in data or behavior. Ensuring the convergence of these clients' models relies on …
Smart Sampling: Helping from Friendly Neighbors for Decentralized Federated Learning
Federated Learning (FL) is gaining widespread interest for its ability to share knowledge
while preserving privacy and reducing communication costs. Unlike Centralized FL …
while preserving privacy and reducing communication costs. Unlike Centralized FL …
Federated Learning Can Find Friends That Are Beneficial
In Federated Learning (FL), the distributed nature and heterogeneity of client data present
both opportunities and challenges. While collaboration among clients can significantly …
both opportunities and challenges. While collaboration among clients can significantly …
PersA-FL: personalized asynchronous federated learning
We study the personalized federated learning problem under asynchronous updates. In this
problem, each client seeks to obtain a personalized model that simultaneously outperforms …
problem, each client seeks to obtain a personalized model that simultaneously outperforms …
Collaborative and Efficient Personalization with Mixtures of Adaptors
Non-iid data is prevalent in real-world federated learning problems. Data heterogeneity can
come in different types in terms of distribution shifts. In this work, we are interested in the …
come in different types in terms of distribution shifts. In this work, we are interested in the …
[HTML][HTML] A Method for Transforming Non-Convex Optimization Problem to Distributed Form
OO Khamisov, OV Khamisov, TD Ganchev… - Mathematics, 2024 - mdpi.com
We propose a novel distributed method for non-convex optimization problems with coupling
equality and inequality constraints. This method transforms the optimization problem into a …
equality and inequality constraints. This method transforms the optimization problem into a …
Enhancing Decentralized and Personalized Federated Learning with Topology Construction
The emerging Federated Learning (FL) permits all workers (eg, mobile devices) to
cooperatively train a model using their local data at the network edge. In order to avoid the …
cooperatively train a model using their local data at the network edge. In order to avoid the …