Scalable load balancing in networked systems: A survey of recent advances

MV der Boor, SC Borst, JSH Van Leeuwaarden… - SIAM Review, 2022 - SIAM
In this survey we provide an overview of recent advances on scalable load balancing
schemes which provide favorable delay performance and yet require minimal …

Optimal load balancing with locality constraints

W Weng, X Zhou, R Srikant - Proceedings of the ACM on Measurement …, 2020 - dl.acm.org
Applications in cloud platforms motivate the study of efficient load balancing under job-
server constraints and server heterogeneity. In this paper, we study load balancing on a …

Steady-state analysis of the join-the-shortest-queue model in the Halfin–Whitt regime

A Braverman - Mathematics of Operations Research, 2020 - pubsonline.informs.org
This paper studies the steady-state properties of the join-the-shortest-queue model in the
Halfin–Whitt regime. We focus on the process tracking the number of idle servers and the …

Scheduling an overloaded multiclass many-server queue with impatient customers

AL Puha, AR Ward - … research & management science in the …, 2019 - pubsonline.informs.org
We describe a fluid model with time-varying input that approximates a multiclass many-
server queue with impatient customers and time-varying arrivals (specifically, the multiclass …

Steady-state analysis of load-balancing algorithms in the sub-Halfin–Whitt regime

X Liu, L Ying - Journal of Applied Probability, 2020 - cambridge.org
We study a class of load-balancing algorithms for many-server systems (N servers). Each
server has a buffer of size (ra positive integer). The proof of the main result is based on the …

Mean-field analysis for load balancing on spatial graphs

D Rutten, D Mukherjee - Abstract Proceedings of the 2023 ACM …, 2023 - dl.acm.org
A pivotal methodological tool behind the analysis of large-scale load balancing systems is
mean-field analysis. The high-level idea is to represent the system state by aggregate …

Hyper-scalable JSQ with sparse feedback

M van der Boor, S Borst… - Proceedings of the ACM on …, 2019 - dl.acm.org
Load balancing algorithms play a vital role in enhancing performance in data centers and
cloud networks. Due to the massive size of these systems, scalability challenges, and …

Steady‐state analysis of load balancing with Coxian‐2 distributed service times

X Liu, K Gong, L Ying - Naval Research Logistics (NRL), 2022 - Wiley Online Library
This paper studies load balancing for many‐server (N servers) systems. Each server has a
buffer of size b− 1, and can have at most one job in service and b− 1 jobs in the buffer. The …

A load balancing system in the many-server heavy-traffic asymptotics

D Hurtado-Lange, ST Maguluri - Queueing Systems, 2022 - Springer
We study a load balancing system in the many-server heavy-traffic regime. We consider a
system with N servers, where jobs arrive to the system according to a Poisson process and …

Universal scaling of distributed queues under load balancing in the super-Halfin-Whitt regime

X Liu, L Ying - IEEE/ACM Transactions on Networking, 2021 - ieeexplore.ieee.org
This paper considers the steady-state performance of load balancing algorithms in a many-
server system with distributed queues. The system has servers, and each server maintains a …