A survey on approximate edge AI for energy efficient autonomous driving services

D Katare, D Perino, J Nurmi, M Warnier… - … Surveys & Tutorials, 2023 - ieeexplore.ieee.org
Autonomous driving services depends on active sensing from modules such as camera,
LiDAR, radar, and communication units. Traditionally, these modules process the sensed …

SoteriaFL: A unified framework for private federated learning with communication compression

Z Li, H Zhao, B Li, Y Chi - Advances in Neural Information …, 2022 - proceedings.neurips.cc
To enable large-scale machine learning in bandwidth-hungry environments such as
wireless networks, significant progress has been made recently in designing communication …

On the effectiveness of partial variance reduction in federated learning with heterogeneous data

B Li, MN Schmidt, TS Alstrøm… - Proceedings of the …, 2023 - openaccess.thecvf.com
Data heterogeneity across clients is a key challenge in federated learning. Prior works
address this by either aligning client and server models or using control variates to correct …

EF21 with bells & whistles: Practical algorithmic extensions of modern error feedback

I Fatkhullin, I Sokolov, E Gorbunov, Z Li… - arXiv preprint arXiv …, 2021 - arxiv.org
First proposed by Seide (2014) as a heuristic, error feedback (EF) is a very popular
mechanism for enforcing convergence of distributed gradient-based optimization methods …

Towards optimal communication complexity in distributed non-convex optimization

KK Patel, L Wang, BE Woodworth… - Advances in Neural …, 2022 - proceedings.neurips.cc
We study the problem of distributed stochastic non-convex optimization with intermittent
communication. We consider the full participation setting where $ M $ machines work in …

BEER: Fast Rate for Decentralized Nonconvex Optimization with Communication Compression

H Zhao, B Li, Z Li, P Richtárik… - Advances in Neural …, 2022 - proceedings.neurips.cc
Communication efficiency has been widely recognized as the bottleneck for large-scale
decentralized machine learning applications in multi-agent or federated environments. To …

Coresets for Vertical Federated Learning: Regularized Linear Regression and -Means Clustering

L Huang, Z Li, J Sun, H Zhao - Advances in Neural …, 2022 - proceedings.neurips.cc
Vertical federated learning (VFL), where data features are stored in multiple parties
distributively, is an important area in machine learning. However, the communication …

CANITA: Faster rates for distributed convex optimization with communication compression

Z Li, P Richtárik - Advances in Neural Information …, 2021 - proceedings.neurips.cc
Due to the high communication cost in distributed and federated learning, methods relying
on compressed communication are becoming increasingly popular. Besides, the best …

Open problems in medical federated learning

JH Yoo, H Jeong, J Lee, TM Chung - International Journal of Web …, 2022 - emerald.com
Purpose This study aims to summarize the critical issues in medical federated learning and
applicable solutions. Also, detailed explanations of how federated learning techniques can …

Simple and optimal stochastic gradient methods for nonsmooth nonconvex optimization

Z Li, J Li - Journal of Machine Learning Research, 2022 - jmlr.org
We propose and analyze several stochastic gradient algorithms for finding stationary points
or local minimum in nonconvex, possibly with nonsmooth regularizer, finite-sum and online …