The evolution of distributed systems for graph neural networks and their origin in graph processing and deep learning: A survey

J Vatter, R Mayer, HA Jacobsen - ACM Computing Surveys, 2023 - dl.acm.org
Graph neural networks (GNNs) are an emerging research field. This specialized deep
neural network architecture is capable of processing graph structured data and bridges the …

Computing graph neural networks: A survey from algorithms to accelerators

S Abadal, A Jain, R Guirado, J López-Alonso… - ACM Computing …, 2021 - dl.acm.org
Graph Neural Networks (GNNs) have exploded onto the machine learning scene in recent
years owing to their capability to model and learn from graph-structured data. Such an ability …

Deep graph library: A graph-centric, highly-performant package for graph neural networks

M Wang, D Zheng, Z Ye, Q Gan, M Li, X Song… - arXiv preprint arXiv …, 2019 - arxiv.org
Advancing research in the emerging field of deep graph learning requires new tools to
support tensor computation over graphs. In this paper, we present the design principles and …

[图书][B] Deep learning on graphs

Y Ma, J Tang - 2021 - books.google.com
Deep learning on graphs has become one of the hottest topics in machine learning. The
book consists of four parts to best accommodate our readers with diverse backgrounds and …

Deep graph library: Towards efficient and scalable deep learning on graphs

MY Wang - ICLR workshop on representation learning on graphs …, 2019 - par.nsf.gov
Advancing research in the emerging field of deep graph learning requires new tools to
support tensor computation over graphs. In this paper, we present the design principles and …

Gnnautoscale: Scalable and expressive graph neural networks via historical embeddings

M Fey, JE Lenssen, F Weichert… - … on machine learning, 2021 - proceedings.mlr.press
We present GNNAutoScale (GAS), a framework for scaling arbitrary message-passing GNNs
to large graphs. GAS prunes entire sub-trees of the computation graph by utilizing historical …

Dorylus: Affordable, scalable, and accurate {GNN} training with distributed {CPU} servers and serverless threads

J Thorpe, Y Qiao, J Eyolfson, S Teng, G Hu… - … USENIX Symposium on …, 2021 - usenix.org
A graph neural network (GNN) enables deep learning on structured graph data. There are
two major GNN training obstacles: 1) it relies on high-end servers with many GPUs which …

P3: Distributed deep graph learning at scale

S Gandhi, AP Iyer - 15th {USENIX} Symposium on Operating Systems …, 2021 - usenix.org
Graph Neural Networks (GNNs) have gained significant attention in the recent past, and
become one of the fastest growing subareas in deep learning. While several new GNN …

Pagraph: Scaling gnn training on large graphs via computation-aware caching

Z Lin, C Li, Y Miao, Y Liu, Y Xu - … of the 11th ACM Symposium on Cloud …, 2020 - dl.acm.org
Emerging graph neural networks (GNNs) have extended the successes of deep learning
techniques against datasets like images and texts to more complex graph-structured data …

ByteGNN: efficient graph neural network training at large scale

C Zheng, H Chen, Y Cheng, Z Song, Y Wu… - Proceedings of the …, 2022 - dl.acm.org
Graph neural networks (GNNs) have shown excellent performance in a wide range of
applications such as recommendation, risk control, and drug discovery. With the increase in …