Self-supervised learning of graph neural networks: A unified review

Y Xie, Z Xu, J Zhang, Z Wang… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
Deep models trained in supervised mode have achieved remarkable success on a variety of
tasks. When labeled samples are limited, self-supervised learning (SSL) is emerging as a …

A comprehensive survey on graph neural networks

Z Wu, S Pan, F Chen, G Long, C Zhang… - IEEE transactions on …, 2020 - ieeexplore.ieee.org
Deep learning has revolutionized many machine learning tasks in recent years, ranging
from image classification and video processing to speech recognition and natural language …

Vision gnn: An image is worth graph of nodes

K Han, Y Wang, J Guo, Y Tang… - Advances in neural …, 2022 - proceedings.neurips.cc
Network architecture plays a key role in the deep learning-based computer vision system.
The widely-used convolutional neural network and transformer treat the image as a grid or …

Representing long-range context for graph neural networks with global attention

Z Wu, P Jain, M Wright, A Mirhoseini… - Advances in …, 2021 - proceedings.neurips.cc
Graph neural networks are powerful architectures for structured datasets. However, current
methods struggle to represent long-range dependencies. Scaling the depth or width of …

Graph self-supervised learning: A survey

Y Liu, M Jin, S Pan, C Zhou, Y Zheng… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
Deep learning on graphs has attracted significant interests recently. However, most of the
works have focused on (semi-) supervised learning, resulting in shortcomings including …

Weisfeiler and lehman go cellular: Cw networks

C Bodnar, F Frasca, N Otter, Y Wang… - Advances in neural …, 2021 - proceedings.neurips.cc
Abstract Graph Neural Networks (GNNs) are limited in their expressive power, struggle with
long-range interactions and lack a principled way to model higher-order structures. These …

Tudataset: A collection of benchmark datasets for learning with graphs

C Morris, NM Kriege, F Bause, K Kersting… - arXiv preprint arXiv …, 2020 - arxiv.org
Recently, there has been an increasing interest in (supervised) learning with graph data,
especially using graph neural networks. However, the development of meaningful …

Infogcl: Information-aware graph contrastive learning

D Xu, W Cheng, D Luo, H Chen… - Advances in Neural …, 2021 - proceedings.neurips.cc
Various graph contrastive learning models have been proposed to improve the performance
of tasks on graph datasets in recent years. While effective and prevalent, these models are …

Self-supervised learning on graphs: Contrastive, generative, or predictive

L Wu, H Lin, C Tan, Z Gao, SZ Li - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Deep learning on graphs has recently achieved remarkable success on a variety of tasks,
while such success relies heavily on the massive and carefully labeled data. However …

On the bottleneck of graph neural networks and its practical implications

U Alon, E Yahav - arXiv preprint arXiv:2006.05205, 2020 - arxiv.org
Since the proposal of the graph neural network (GNN) by Gori et al.(2005) and Scarselli et
al.(2008), one of the major problems in training GNNs was their struggle to propagate …