Exoshuffle: An extensible shuffle architecture

FS Luan, S Wang, S Yagati, S Kim, K Lien… - Proceedings of the …, 2023 - dl.acm.org
Shuffle is one of the most expensive communication primitives in distributed data processing
and is difficult to scale. Prior work addresses the scalability challenges of shuffle by building …

Towards a Distributed OS for Data-Intensive Cloud Applications

S Wang - 2023 - escholarship.org
Commodity hardware is reaching fundamental limits, while the demands of data-intensive
applications continue to grow. Thus, we now rely on horizontal scale-out and hardware …