A comprehensive survey on coded distributed computing: Fundamentals, challenges, and networking applications

JS Ng, WYB Lim, NC Luong, Z Xiong… - … Surveys & Tutorials, 2021 - ieeexplore.ieee.org
Distributed computing has become a common approach for large-scale computation tasks
due to benefits such as high reliability, scalability, computation speed, and cost …

Communication-computation efficient gradient coding

M Ye, E Abbe - International Conference on Machine …, 2018 - proceedings.mlr.press
This paper develops coding techniques to reduce the running time of distributed learning
tasks. It characterizes the fundamental tradeoff to compute gradients in terms of three …

Hierarchical coded computation

N Ferdinand, SC Draper - 2018 IEEE International Symposium …, 2018 - ieeexplore.ieee.org
Coded computation is a method to mitigate “stragglers” in distributed computing systems
through the use of error correction coding that has lately received significant attention. First …

Oversketch: Approximate matrix multiplication for the cloud

V Gupta, S Wang, T Courtade… - … Conference on Big …, 2018 - ieeexplore.ieee.org
We propose OverSketch, an approximate algorithm for distributed matrix multiplication in
serverless computing. OverSketch leverages ideas from matrix sketching and high …

Oversketched newton: Fast convex optimization for serverless systems

V Gupta, S Kadhe, T Courtade… - … Conference on Big …, 2020 - ieeexplore.ieee.org
Motivated by recent developments in serverless systems for large-scale computation as well
as improvements in scalable randomized matrix algorithms, we develop OverSketched …

A survey of coded distributed computing

JS Ng, WYB Lim, NC Luong, Z Xiong… - arXiv preprint arXiv …, 2020 - arxiv.org
Distributed computing has become a common approach for large-scale computation of tasks
due to benefits such as high reliability, scalability, computation speed, and costeffectiveness …

Optimal load allocation for coded distributed computation in heterogeneous clusters

D Kim, H Park, JK Choi - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
Recently, coding has been a useful technique to mitigate stragglers' effect in distributed
computing. However, coding in this context has been mainly explored assuming …

Coded federated learning for communication-efficient edge computing: A survey

Y Zhang, T Gao, C Li, CW Tan - IEEE Open Journal of the …, 2024 - ieeexplore.ieee.org
In the era of artificial intelligence and big data, the demand for data processing has surged,
leading to larger datasets and computation capability. Distributed machine learning (DML) …

Successive approximation coding for distributed matrix multiplication

S Kiani, SC Draper - IEEE Journal on Selected Areas in …, 2022 - ieeexplore.ieee.org
Coded distributed computing was recently introduced to mitigate the effect of stragglers on
distributed computing systems. This paper combines ideas of approximate and coded …

Hierarchical coded gradient aggregation for learning at the edge

S Prakash, A Reisizadeh, R Pedarsani… - 2020 IEEE …, 2020 - ieeexplore.ieee.org
Client devices at the edge are generating increasingly large amounts of rich data suitable for
learning powerful statistical models. However, privacy concerns and heavy communication …