Mlpinit: Embarrassingly simple gnn training acceleration with mlp initialization

X Han, T Zhao, Y Liu, X Hu, N Shah - arXiv preprint arXiv:2210.00102, 2022 - arxiv.org
Training graph neural networks (GNNs) on large graphs is complex and extremely time
consuming. This is attributed to overheads caused by sparse matrix multiplication, which are …

Submix: Learning to mix graph sampling heuristics

S Abu-El-Haija, JV Dillon, B Fatemi… - Uncertainty in …, 2023 - proceedings.mlr.press
Sampling subgraphs for training Graph Neural Networks (GNNs) is receiving much attention
from the GNN community. While a variety of methods have been proposed, each method …

Asynchronous algorithmic alignment with cocycles

AJ Dudzik, T von Glehn, R Pascanu… - Learning on Graphs …, 2024 - proceedings.mlr.press
State-of-the-art neural algorithmic reasoners make use of message passing in graph neural
networks (GNNs). But typical GNNs blur the distinction between the definition and invocation …

Let your graph do the talking: Encoding structured data for llms

B Perozzi, B Fatemi, D Zelle, A Tsitsulin… - arXiv preprint arXiv …, 2024 - arxiv.org
How can we best encode structured data into sequential form for use in large language
models (LLMs)? In this work, we introduce a parameter-efficient method to explicitly …

A network science perspective of graph convolutional networks: A survey

M Jia, B Gabrys, K Musial - IEEE Access, 2023 - ieeexplore.ieee.org
The mining and exploitation of graph structural information have been the focal points in the
study of complex networks. Traditional structural measures in Network Science focus on the …

Ugsl: A unified framework for benchmarking graph structure learning

B Fatemi, S Abu-El-Haija, A Tsitsulin, M Kazemi… - arXiv preprint arXiv …, 2023 - arxiv.org
Graph neural networks (GNNs) demonstrate outstanding performance in a broad range of
applications. While the majority of GNN applications assume that a graph structure is given …

Zero-shot transfer learning within a heterogeneous graph via knowledge transfer networks

M Yoon, J Palowitch, D Zelle, Z Hu… - Advances in …, 2022 - proceedings.neurips.cc
Data continuously emitted from industrial ecosystems such as social or e-commerce
platforms are commonly represented as heterogeneous graphs (HG) composed of multiple …

Optimizing zx-diagrams with deep reinforcement learning

M Nägele, F Marquardt - arXiv preprint arXiv:2311.18588, 2023 - pure.mpg.de
ZX-diagrams are a powerful graphical language for the description of quantum processes
with applications in fundamental quantum mechanics, quantum circuit optimization, tensor …

Graph learning indexer: A contributor-friendly and metadata-rich platform for graph learning benchmarks

J Ma, X Zhang, H Fan, J Huang, T Li… - Learning on Graphs …, 2022 - proceedings.mlr.press
Establishing open and general benchmarks has been a critical driving force behind the
success of modern machine learning techniques. As machine learning is being applied to …

Text reading order in uncontrolled conditions by sparse graph segmentation

R Wang, Y Fujii, A Bissacco - International Conference on Document …, 2023 - Springer
Text reading order is a crucial aspect in the output of an OCR engine, with a large impact on
downstream tasks. Its difficulty lies in the large variation of domain specific layout structures …