The evolution of distributed systems for graph neural networks and their origin in graph processing and deep learning: A survey
Graph neural networks (GNNs) are an emerging research field. This specialized deep
neural network architecture is capable of processing graph structured data and bridges the …
neural network architecture is capable of processing graph structured data and bridges the …
Computing graph neural networks: A survey from algorithms to accelerators
Graph Neural Networks (GNNs) have exploded onto the machine learning scene in recent
years owing to their capability to model and learn from graph-structured data. Such an ability …
years owing to their capability to model and learn from graph-structured data. Such an ability …
Torchsparse: Efficient point cloud inference engine
Deep learning on point clouds has received increased attention thanks to its wide
applications in AR/VR and autonomous driving. These applications require low latency and …
applications in AR/VR and autonomous driving. These applications require low latency and …
Ansor: Generating {High-Performance} tensor programs for deep learning
High-performance tensor programs are crucial to guarantee efficient execution of deep
neural networks. However, obtaining performant tensor programs for different operators on …
neural networks. However, obtaining performant tensor programs for different operators on …
Distgnn: Scalable distributed training for large-scale graph neural networks
Full-batch training on Graph Neural Networks (GNN) to learn the structure of large graphs is
a critical problem that needs to scale to hundreds of compute nodes to be feasible. It is …
a critical problem that needs to scale to hundreds of compute nodes to be feasible. It is …
Sparsetir: Composable abstractions for sparse compilation in deep learning
Sparse tensors are rapidly becoming critical components of modern deep learning
workloads. However, developing high-performance sparse operators can be difficult and …
workloads. However, developing high-performance sparse operators can be difficult and …
Distributed graph neural network training: A survey
Graph neural networks (GNNs) are a type of deep learning models that are trained on
graphs and have been successfully applied in various domains. Despite the effectiveness of …
graphs and have been successfully applied in various domains. Despite the effectiveness of …
Parallel and distributed graph neural networks: An in-depth concurrency analysis
Graph neural networks (GNNs) are among the most powerful tools in deep learning. They
routinely solve complex problems on unstructured networks, such as node classification …
routinely solve complex problems on unstructured networks, such as node classification …
GNN at the edge: Cost-efficient graph neural network processing over distributed edge servers
Edge intelligence has arisen as a promising computing paradigm for supporting
miscellaneous smart applications that rely on machine learning techniques. While the …
miscellaneous smart applications that rely on machine learning techniques. While the …
High-Performance and Programmable Attentional Graph Neural Networks with Global Tensor Formulations
Graph attention models (A-GNNs), a type of Graph Neural Networks (GNNs), have been
shown to be more powerful than simpler convolutional GNNs (C-GNNs). However, A-GNNs …
shown to be more powerful than simpler convolutional GNNs (C-GNNs). However, A-GNNs …