Fetchsgd: Communication-efficient federated learning with sketching

D Rothchild, A Panda, E Ullah, N Ivkin… - International …, 2020 - proceedings.mlr.press
Existing approaches to federated learning suffer from a communication bottleneck as well as
convergence issues due to sparse client participation. In this paper we introduce a novel …

Communication-efficient distributed SGD with sketching

N Ivkin, D Rothchild, E Ullah… - Advances in Neural …, 2019 - proceedings.neurips.cc
Large-scale distributed training of neural networks is often limited by network bandwidth,
wherein the communication time overwhelms the local computation time. Motivated by the …

A framework for adversarially robust streaming algorithms

O Ben-Eliezer, R Jayaram, DP Woodruff… - ACM Journal of the ACM …, 2022 - dl.acm.org
We investigate the adversarial robustness of streaming algorithms. In this context, an
algorithm is considered robust if its performance guarantees hold even if the stream is …

Relative error tensor low rank approximation

Z Song, DP Woodruff, P Zhong - Proceedings of the Thirtieth Annual ACM …, 2019 - SIAM
We consider relative error low rank approximation of tensors with respect to the Frobenius
norm. Namely, given an order-q tensor A∊ ℝ∏ i= 1 q ni, output a rank-k tensor B for which …

Tight bounds for adversarially robust streams and sliding windows via difference estimators

DP Woodruff, S Zhou - 2021 IEEE 62nd Annual Symposium on …, 2022 - ieeexplore.ieee.org
In the adversarially robust streaming model, a stream of elements is presented to an
algorithm and is allowed to depend on the output of the algorithm at earlier times during the …

Memory bounds for the experts problem

V Srinivas, DP Woodruff, Z Xu, S Zhou - … of the 54th Annual ACM SIGACT …, 2022 - dl.acm.org
Online learning with expert advice is a fundamental problem of sequential prediction. In this
problem, the algorithm has access to a set of n “experts” who make predictions on each day …

Improved frequency estimation algorithms with and without predictions

A Aamand, J Chen, H Nguyen… - Advances in Neural …, 2024 - proceedings.neurips.cc
Estimating frequencies of elements appearing in a data stream is a key task in large-scale
data analysis. Popular sketching approaches to this problem (eg, CountMin and …

Lp Samplers and Their Applications: A Survey

G Cormode, H Jowhari - ACM Computing Surveys (CSUR), 2019 - dl.acm.org
The notion of L p sampling, and corresponding algorithms known as L p samplers, has
found a wide range of applications in the design of data stream algorithms and beyond. In …

Streaming Euclidean k-median and k-means with o (log n) Space

V Cohen-Addad, DP Woodruff… - 2023 IEEE 64th Annual …, 2023 - ieeexplore.ieee.org
We consider the classic Euclidean k-median and k-means objective on data streams, where
the goal is to provide a (1+ε)-approximation to the optimal k-median or k-means solution …

Heavy hitters via cluster-preserving clustering

KG Larsen, J Nelson, HL Nguyễn… - Communications of the …, 2019 - dl.acm.org
We develop a new algorithm for the turnstile heavy hitters problem in general turnstile
streams, the EXPANDERSKETCH, which finds the approximate top-k items in a universe of …