A comprehensive survey on pretrained foundation models: A history from bert to chatgpt

C Zhou, Q Li, C Li, J Yu, Y Liu, G Wang… - International Journal of …, 2024 - Springer
Abstract Pretrained Foundation Models (PFMs) are regarded as the foundation for various
downstream tasks across different data modalities. A PFM (eg, BERT, ChatGPT, GPT-4) is …

A survey on graph kernels

NM Kriege, FD Johansson, C Morris - Applied Network Science, 2020 - Springer
Graph kernels have become an established and widely-used technique for solving
classification tasks on graphs. This survey gives a comprehensive overview of techniques …

Graph neural networks: foundation, frontiers and applications

L Wu, P Cui, J Pei, L Zhao, X Guo - … of the 28th ACM SIGKDD Conference …, 2022 - dl.acm.org
The field of graph neural networks (GNNs) has seen rapid and incredible strides over the
recent years. Graph neural networks, also known as deep learning on graphs, graph …

Tudataset: A collection of benchmark datasets for learning with graphs

C Morris, NM Kriege, F Bause, K Kersting… - arXiv preprint arXiv …, 2020 - arxiv.org
Recently, there has been an increasing interest in (supervised) learning with graph data,
especially using graph neural networks. However, the development of meaningful …

Weisfeiler and leman go machine learning: The story so far

C Morris, Y Lipman, H Maron, B Rieck… - The Journal of Machine …, 2023 - dl.acm.org
In recent years, algorithms and neural architectures based on the Weisfeiler-Leman
algorithm, a well-known heuristic for the graph isomorphism problem, have emerged as a …

Position-aware graph neural networks

J You, R Ying, J Leskovec - International conference on …, 2019 - proceedings.mlr.press
Learning node embeddings that capture a node's position within the broader graph structure
is crucial for many prediction tasks on graphs. However, existing Graph Neural Network …

Link prediction based on graph neural networks

M Zhang, Y Chen - Advances in neural information …, 2018 - proceedings.neurips.cc
Link prediction is a key problem for network-structured data. Link prediction heuristics use
some score functions, such as common neighbors and Katz index, to measure the likelihood …

Discriminative embeddings of latent variable models for structured data

H Dai, B Dai, L Song - International conference on machine …, 2016 - proceedings.mlr.press
Kernel classifiers and regressors designed for structured data, such as sequences, trees
and graphs, have significantly advanced a number of interdisciplinary areas such as …

Random walk graph neural networks

G Nikolentzos, M Vazirgiannis - Advances in Neural …, 2020 - proceedings.neurips.cc
In recent years, graph neural networks (GNNs) have become the de facto tool for performing
machine learning tasks on graphs. Most GNNs belong to the family of message passing …

Anonymous walk embeddings

S Ivanov, E Burnaev - International conference on machine …, 2018 - proceedings.mlr.press
The task of representing entire graphs has seen a surge of prominent results, mainly due to
learning convolutional neural networks (CNNs) on graph-structured data. While CNNs …