A comprehensive survey on distributed training of graph neural networks

H Lin, M Yan, X Ye, D Fan, S Pan… - Proceedings of the …, 2023 - ieeexplore.ieee.org
Graph neural networks (GNNs) have been demonstrated to be a powerful algorithmic model
in broad application fields for their effectiveness in learning over graphs. To scale GNN …

A survey of dynamic graph neural networks

Y Zheng, L Yi, Z Wei - Frontiers of Computer Science, 2025 - Springer
Graph neural networks (GNNs) have emerged as a powerful tool for effectively mining and
learning from graph-structured data, with applications spanning numerous domains …

Parallel and distributed graph neural networks: An in-depth concurrency analysis

M Besta, T Hoefler - IEEE Transactions on Pattern Analysis and …, 2024 - ieeexplore.ieee.org
Graph neural networks (GNNs) are among the most powerful tools in deep learning. They
routinely solve complex problems on unstructured networks, such as node classification …

Disttgl: Distributed memory-based temporal graph neural network training

H Zhou, D Zheng, X Song, G Karypis… - Proceedings of the …, 2023 - dl.acm.org
Memory-based Temporal Graph Neural Networks are powerful tools in dynamic graph
representation learning and have demonstrated superior performance in many real-world …

Redundancy-free high-performance dynamic GNN training with hierarchical pipeline parallelism

Y Xia, Z Zhang, H Wang, D Yang, X Zhou… - Proceedings of the 32nd …, 2023 - dl.acm.org
Temporal Graph Neural Networks (TGNNs) extend the success of Graph Neural Networks to
dynamic graphs. Distributed TGNN training requires efficiently tackling temporal …

ETC: Efficient Training of Temporal Graph Neural Networks over Large-scale Dynamic Graphs

S Gao, Y Li, Y Shen, Y Shao, L Chen - Proceedings of the VLDB …, 2024 - dl.acm.org
Dynamic graphs play a crucial role in various real-world applications, such as link prediction
and node classification on social media and e-commerce platforms. Temporal Graph Neural …

BLAD: Adaptive Load Balanced Scheduling and Operator Overlap Pipeline For Accelerating The Dynamic GNN Training

K Fu, Q Chen, Y Yang, J Shi, C Li, M Guo - Proceedings of the …, 2023 - dl.acm.org
Dynamic graph networks are widely used for learning time-evolving graphs, but prior work
on training these networks is inefficient due to communication overhead, long …

PiPAD: pipelined and parallel dynamic GNN training on GPUs

C Wang, D Sun, Y Bai - Proceedings of the 28th ACM SIGPLAN Annual …, 2023 - dl.acm.org
Dynamic Graph Neural Networks (DGNNs) have been widely applied in various real-life
applications, such as link prediction and pandemic forecast, to capture both static structural …

Cognn: efficient scheduling for concurrent gnn training on gpus

Q Sun, Y Liu, H Yang, R Zhang, M Dun… - … Conference for High …, 2022 - ieeexplore.ieee.org
Graph neural networks (GNNs) suffer from low GPU utilization due to frequent memory
accesses. Existing concurrent training mechanisms cannot be directly adapted to GNNs …

A Comprehensive Survey of Dynamic Graph Neural Networks: Models, Frameworks, Benchmarks, Experiments and Challenges

ZZ Feng, R Wang, TX Wang, M Song, S Wu… - arXiv preprint arXiv …, 2024 - arxiv.org
Dynamic Graph Neural Networks (GNNs) combine temporal information with GNNs to
capture structural, temporal, and contextual relationships in dynamic graphs simultaneously …