A survey on approximate edge AI for energy efficient autonomous driving services
Autonomous driving services depends on active sensing from modules such as camera,
LiDAR, radar, and communication units. Traditionally, these modules process the sensed …
LiDAR, radar, and communication units. Traditionally, these modules process the sensed …
SoteriaFL: A unified framework for private federated learning with communication compression
To enable large-scale machine learning in bandwidth-hungry environments such as
wireless networks, significant progress has been made recently in designing communication …
wireless networks, significant progress has been made recently in designing communication …
On the effectiveness of partial variance reduction in federated learning with heterogeneous data
Data heterogeneity across clients is a key challenge in federated learning. Prior works
address this by either aligning client and server models or using control variates to correct …
address this by either aligning client and server models or using control variates to correct …
EF21 with bells & whistles: Practical algorithmic extensions of modern error feedback
First proposed by Seide (2014) as a heuristic, error feedback (EF) is a very popular
mechanism for enforcing convergence of distributed gradient-based optimization methods …
mechanism for enforcing convergence of distributed gradient-based optimization methods …
Towards optimal communication complexity in distributed non-convex optimization
We study the problem of distributed stochastic non-convex optimization with intermittent
communication. We consider the full participation setting where $ M $ machines work in …
communication. We consider the full participation setting where $ M $ machines work in …
BEER: Fast Rate for Decentralized Nonconvex Optimization with Communication Compression
Communication efficiency has been widely recognized as the bottleneck for large-scale
decentralized machine learning applications in multi-agent or federated environments. To …
decentralized machine learning applications in multi-agent or federated environments. To …
Coresets for Vertical Federated Learning: Regularized Linear Regression and -Means Clustering
Vertical federated learning (VFL), where data features are stored in multiple parties
distributively, is an important area in machine learning. However, the communication …
distributively, is an important area in machine learning. However, the communication …
CANITA: Faster rates for distributed convex optimization with communication compression
Z Li, P Richtárik - Advances in Neural Information …, 2021 - proceedings.neurips.cc
Due to the high communication cost in distributed and federated learning, methods relying
on compressed communication are becoming increasingly popular. Besides, the best …
on compressed communication are becoming increasingly popular. Besides, the best …
Open problems in medical federated learning
Purpose This study aims to summarize the critical issues in medical federated learning and
applicable solutions. Also, detailed explanations of how federated learning techniques can …
applicable solutions. Also, detailed explanations of how federated learning techniques can …
Simple and optimal stochastic gradient methods for nonsmooth nonconvex optimization
We propose and analyze several stochastic gradient algorithms for finding stationary points
or local minimum in nonconvex, possibly with nonsmooth regularizer, finite-sum and online …
or local minimum in nonconvex, possibly with nonsmooth regularizer, finite-sum and online …