xCCL: A Survey of Industry-Led Collective Communication Libraries for Deep Learning
Abstract Machine learning techniques have become ubiquitous both in industry and
academic applications. Increasing model sizes and training data volumes necessitate fast …
academic applications. Increasing model sizes and training data volumes necessitate fast …
[图书][B] High-performance big data computing
An in-depth overview of an emerging field that brings together high-performance computing,
big data processing, and deep lLearning. Over the last decade, the exponential explosion of …
big data processing, and deep lLearning. Over the last decade, the exponential explosion of …
Hpc meets cloud: Building efficient clouds for hpc, big data, and deep learning middleware and applications
Significant growth has been witnessed during the last few years in HPC clusters with multi-
/many-core processors, accelerators, and high-performance interconnects (such as …
/many-core processors, accelerators, and high-performance interconnects (such as …
[PDF][PDF] Accelerating Big Data Processing in the Cloud with Scalable Communication and I/O Schemes
With the advent of cloud computing, the field of Big Data has seen rapid growth. Most cloud
providers provide hardware resources such as NVMe SSDs, large memory nodes, and SR …
providers provide hardware resources such as NVMe SSDs, large memory nodes, and SR …