A Damped Newton Method Achieves Global and Local Quadratic Convergence Rate

S Hanzely, D Kamzolov… - Advances in …, 2022 - proceedings.neurips.cc
In this paper, we present the first stepsize schedule for Newton method resulting in fast
global and local convergence guarantees. In particular, we a) prove an $\mathcal O\left …

Towards more suitable personalization in federated learning via decentralized partial model training

Y Shi, Y Liu, Y Sun, Z Lin, L Shen, X Wang… - arXiv preprint arXiv …, 2023 - arxiv.org
Personalized federated learning (PFL) aims to produce the greatest personalized model for
each client to face an insurmountable problem--data heterogeneity in real FL systems …

Decentralized Directed Collaboration for Personalized Federated Learning

Y Liu, Y Shi, Q Li, B Wu, X Wang… - Proceedings of the …, 2024 - openaccess.thecvf.com
Abstract Personalized Federated Learning (PFL) is proposed to find the greatest
personalized models for each client. To avoid the central failure and communication …

Personalized decentralized federated learning with knowledge distillation

E Jeong, M Kountouris - ICC 2023-IEEE International …, 2023 - ieeexplore.ieee.org
Personalization in federated learning (FL) functions as a coordinator for clients with high
variance in data or behavior. Ensuring the convergence of these clients' models relies on …

Smart Sampling: Helping from Friendly Neighbors for Decentralized Federated Learning

L Wang, Y Chen, Y Guo, X Tang - arXiv preprint arXiv:2407.04460, 2024 - arxiv.org
Federated Learning (FL) is gaining widespread interest for its ability to share knowledge
while preserving privacy and reducing communication costs. Unlike Centralized FL …

Federated Learning Can Find Friends That Are Beneficial

N Tupitsa, S Horváth, M Takáč, E Gorbunov - arXiv preprint arXiv …, 2024 - arxiv.org
In Federated Learning (FL), the distributed nature and heterogeneity of client data present
both opportunities and challenges. While collaboration among clients can significantly …

PersA-FL: personalized asynchronous federated learning

MT Toghani, S Lee, CA Uribe - Optimization Methods and Software, 2023 - Taylor & Francis
We study the personalized federated learning problem under asynchronous updates. In this
problem, each client seeks to obtain a personalized model that simultaneously outperforms …

Collaborative and Efficient Personalization with Mixtures of Adaptors

AJ Almansoori, S Horváth, M Takáč - arXiv preprint arXiv:2410.03497, 2024 - arxiv.org
Non-iid data is prevalent in real-world federated learning problems. Data heterogeneity can
come in different types in terms of distribution shifts. In this work, we are interested in the …

[HTML][HTML] A Method for Transforming Non-Convex Optimization Problem to Distributed Form

OO Khamisov, OV Khamisov, TD Ganchev… - Mathematics, 2024 - mdpi.com
We propose a novel distributed method for non-convex optimization problems with coupling
equality and inequality constraints. This method transforms the optimization problem into a …

Enhancing Decentralized and Personalized Federated Learning with Topology Construction

S Chen, Y Xu, H Xu, Z Ma… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
The emerging Federated Learning (FL) permits all workers (eg, mobile devices) to
cooperatively train a model using their local data at the network edge. In order to avoid the …