Fetchsgd: Communication-efficient federated learning with sketching
Existing approaches to federated learning suffer from a communication bottleneck as well as
convergence issues due to sparse client participation. In this paper we introduce a novel …
convergence issues due to sparse client participation. In this paper we introduce a novel …
Communication-efficient distributed SGD with sketching
Large-scale distributed training of neural networks is often limited by network bandwidth,
wherein the communication time overwhelms the local computation time. Motivated by the …
wherein the communication time overwhelms the local computation time. Motivated by the …
A framework for adversarially robust streaming algorithms
We investigate the adversarial robustness of streaming algorithms. In this context, an
algorithm is considered robust if its performance guarantees hold even if the stream is …
algorithm is considered robust if its performance guarantees hold even if the stream is …
Relative error tensor low rank approximation
We consider relative error low rank approximation of tensors with respect to the Frobenius
norm. Namely, given an order-q tensor A∊ ℝ∏ i= 1 q ni, output a rank-k tensor B for which …
norm. Namely, given an order-q tensor A∊ ℝ∏ i= 1 q ni, output a rank-k tensor B for which …
Tight bounds for adversarially robust streams and sliding windows via difference estimators
DP Woodruff, S Zhou - 2021 IEEE 62nd Annual Symposium on …, 2022 - ieeexplore.ieee.org
In the adversarially robust streaming model, a stream of elements is presented to an
algorithm and is allowed to depend on the output of the algorithm at earlier times during the …
algorithm and is allowed to depend on the output of the algorithm at earlier times during the …
Memory bounds for the experts problem
Online learning with expert advice is a fundamental problem of sequential prediction. In this
problem, the algorithm has access to a set of n “experts” who make predictions on each day …
problem, the algorithm has access to a set of n “experts” who make predictions on each day …
Improved frequency estimation algorithms with and without predictions
Estimating frequencies of elements appearing in a data stream is a key task in large-scale
data analysis. Popular sketching approaches to this problem (eg, CountMin and …
data analysis. Popular sketching approaches to this problem (eg, CountMin and …
Lp Samplers and Their Applications: A Survey
The notion of L p sampling, and corresponding algorithms known as L p samplers, has
found a wide range of applications in the design of data stream algorithms and beyond. In …
found a wide range of applications in the design of data stream algorithms and beyond. In …
Streaming Euclidean k-median and k-means with o (log n) Space
V Cohen-Addad, DP Woodruff… - 2023 IEEE 64th Annual …, 2023 - ieeexplore.ieee.org
We consider the classic Euclidean k-median and k-means objective on data streams, where
the goal is to provide a (1+ε)-approximation to the optimal k-median or k-means solution …
the goal is to provide a (1+ε)-approximation to the optimal k-median or k-means solution …
Heavy hitters via cluster-preserving clustering
We develop a new algorithm for the turnstile heavy hitters problem in general turnstile
streams, the EXPANDERSKETCH, which finds the approximate top-k items in a universe of …
streams, the EXPANDERSKETCH, which finds the approximate top-k items in a universe of …