The evolution of distributed systems for graph neural networks and their origin in graph processing and deep learning: A survey

J Vatter, R Mayer, HA Jacobsen - ACM Computing Surveys, 2023 - dl.acm.org
Graph neural networks (GNNs) are an emerging research field. This specialized deep
neural network architecture is capable of processing graph structured data and bridges the …

Distributed graph neural network training: A survey

Y Shao, H Li, X Gu, H Yin, Y Li, X Miao… - ACM Computing …, 2024 - dl.acm.org
Graph neural networks (GNNs) are a type of deep learning models that are trained on
graphs and have been successfully applied in various domains. Despite the effectiveness of …

Accelerating training and inference of graph neural networks with fast sampling and pipelining

T Kaler, N Stathas, A Ouyang… - Proceedings of …, 2022 - proceedings.mlsys.org
Improving the training and inference performance of graph neural networks (GNNs) is faced
with a challenge uncommon in general neural networks: creating mini-batches requires a lot …

Parallel and distributed graph neural networks: An in-depth concurrency analysis

M Besta, T Hoefler - IEEE Transactions on Pattern Analysis and …, 2024 - ieeexplore.ieee.org
Graph neural networks (GNNs) are among the most powerful tools in deep learning. They
routinely solve complex problems on unstructured networks, such as node classification …

Communication-efficient graph neural networks with probabilistic neighborhood expansion analysis and caching

T Kaler, A Iliopoulos, P Murzynowski… - Proceedings of …, 2023 - proceedings.mlsys.org
Training and inference with graph neural networks (GNNs) on massive graphs in a
distributed environment has been actively studied since the inception of GNNs, owing to the …

High-Performance and Programmable Attentional Graph Neural Networks with Global Tensor Formulations

M Besta, P Renc, R Gerstenberger… - Proceedings of the …, 2023 - dl.acm.org
Graph attention models (A-GNNs), a type of Graph Neural Networks (GNNs), have been
shown to be more powerful than simpler convolutional GNNs (C-GNNs). However, A-GNNs …

Lotan: Bridging the gap between gnns and scalable graph analytics engines

Y Zhang, A Kumar - Proceedings of the VLDB Endowment, 2023 - dl.acm.org
Recent advances in Graph Neural Networks (GNNs) have changed the landscape of
modern graph analytics. The complexity of GNN training and the scalability challenges have …

Argo: An auto-tuning runtime system for scalable gnn training on multi-core processor

YC Lin, Y Chen, S Gobriel, N Jain, GK Jha… - arXiv preprint arXiv …, 2024 - arxiv.org
As Graph Neural Networks (GNNs) become popular, libraries like PyTorch-Geometric (PyG)
and Deep Graph Library (DGL) are proposed; these libraries have emerged as the de facto …

Can Graph Reordering Speed Up Graph Neural Network Training? An Experimental Study

N Merkel, P Toussing, R Mayer… - arXiv preprint arXiv …, 2024 - arxiv.org
Graph neural networks (GNNs) are a type of neural network capable of learning on graph-
structured data. However, training GNNs on large-scale graphs is challenging due to …

[图书][B] High-throughput Data Systems for Deep Learning Workloads

Y Zhang - 2023 - search.proquest.com
Abstract Artificial Intelligence (AI) and Deep Learning (DL) have gained enormous popularity
and have seen wide adoption across different domains. They ushered in an era of huge …