Helios: An Efficient Out-of-core GNN Training System on Terabyte-scale Graphs with In-memory Performance
J Sun, M Sun, Z Zhang, J Xie, Z Shi, Z Yang… - arXiv preprint arXiv …, 2023 - arxiv.org
Training graph neural networks (GNNs) on large-scale graph data holds immense promise
for numerous real-world applications but remains a great challenge. Several disk-based …
for numerous real-world applications but remains a great challenge. Several disk-based …
OUTRE: An OUT-of-Core De-REdundancy GNN Training Framework for Massive Graphs within A Single Machine
Sampling-based Graph Neural Networks (GNNs) have become the de facto standard for
handling various graph learning tasks on large-scale graphs. As the graph size grows larger …
handling various graph learning tasks on large-scale graphs. As the graph size grows larger …
BGS: Accelerate GNN training on multiple GPUs
Abstract Emerging Graph Neural Networks (GNNs) have made significant progress in
processing graph-structured data, yet existing GNN frameworks face scalability issues when …
processing graph-structured data, yet existing GNN frameworks face scalability issues when …
FlashFlex: Accommodating Large Language Model Training over Heterogeneous Environment
Training large language model (LLM) is a computationally intensive task, which is typically
conducted in data centers with homogeneous high-performance GPUs. This paper explores …
conducted in data centers with homogeneous high-performance GPUs. This paper explores …
In situ neighborhood sampling for large-scale GNN training
Graph Neural Network (GNN) training algorithms commonly perform neighborhood
sampling to construct fixed-size mini-batches for weight aggregation on GPUs. State-of-the …
sampling to construct fixed-size mini-batches for weight aggregation on GPUs. State-of-the …
Exploring Page-based RDMA for Irregular GPU Workloads. A case study on NVMe-backed GNN Execution
Paged memory systems for GPUs like NVIDIA's Unified Virtual Memory, offer a simple
method for programmers to create out-of-core programs on GPUs. In the case of storage …
method for programmers to create out-of-core programs on GPUs. In the case of storage …