A comprehensive survey on coded distributed computing: Fundamentals, challenges, and networking applications
Distributed computing has become a common approach for large-scale computation tasks
due to benefits such as high reliability, scalability, computation speed, and cost …
due to benefits such as high reliability, scalability, computation speed, and cost …
Communication-computation efficient gradient coding
This paper develops coding techniques to reduce the running time of distributed learning
tasks. It characterizes the fundamental tradeoff to compute gradients in terms of three …
tasks. It characterizes the fundamental tradeoff to compute gradients in terms of three …
Hierarchical coded computation
N Ferdinand, SC Draper - 2018 IEEE International Symposium …, 2018 - ieeexplore.ieee.org
Coded computation is a method to mitigate “stragglers” in distributed computing systems
through the use of error correction coding that has lately received significant attention. First …
through the use of error correction coding that has lately received significant attention. First …
Oversketch: Approximate matrix multiplication for the cloud
We propose OverSketch, an approximate algorithm for distributed matrix multiplication in
serverless computing. OverSketch leverages ideas from matrix sketching and high …
serverless computing. OverSketch leverages ideas from matrix sketching and high …
Oversketched newton: Fast convex optimization for serverless systems
Motivated by recent developments in serverless systems for large-scale computation as well
as improvements in scalable randomized matrix algorithms, we develop OverSketched …
as improvements in scalable randomized matrix algorithms, we develop OverSketched …
A survey of coded distributed computing
Distributed computing has become a common approach for large-scale computation of tasks
due to benefits such as high reliability, scalability, computation speed, and costeffectiveness …
due to benefits such as high reliability, scalability, computation speed, and costeffectiveness …
Optimal load allocation for coded distributed computation in heterogeneous clusters
Recently, coding has been a useful technique to mitigate stragglers' effect in distributed
computing. However, coding in this context has been mainly explored assuming …
computing. However, coding in this context has been mainly explored assuming …
Coded federated learning for communication-efficient edge computing: A survey
In the era of artificial intelligence and big data, the demand for data processing has surged,
leading to larger datasets and computation capability. Distributed machine learning (DML) …
leading to larger datasets and computation capability. Distributed machine learning (DML) …
Successive approximation coding for distributed matrix multiplication
Coded distributed computing was recently introduced to mitigate the effect of stragglers on
distributed computing systems. This paper combines ideas of approximate and coded …
distributed computing systems. This paper combines ideas of approximate and coded …
Hierarchical coded gradient aggregation for learning at the edge
Client devices at the edge are generating increasingly large amounts of rich data suitable for
learning powerful statistical models. However, privacy concerns and heavy communication …
learning powerful statistical models. However, privacy concerns and heavy communication …