A comprehensive survey on pretrained foundation models: A history from bert to chatgpt

C Zhou, Q Li, C Li, J Yu, Y Liu, G Wang… - International Journal of …, 2024 - Springer
Abstract Pretrained Foundation Models (PFMs) are regarded as the foundation for various
downstream tasks across different data modalities. A PFM (eg, BERT, ChatGPT, GPT-4) is …

Towards data-centric graph machine learning: Review and outlook

X Zheng, Y Liu, Z Bao, M Fang, X Hu, AWC Liew… - arXiv preprint arXiv …, 2023 - arxiv.org
Data-centric AI, with its primary focus on the collection, management, and utilization of data
to drive AI models and applications, has attracted increasing attention in recent years. In this …

LightGCL: Simple yet effective graph contrastive learning for recommendation

X Cai, C Huang, L Xia, X Ren - arXiv preprint arXiv:2302.08191, 2023 - arxiv.org
Graph neural network (GNN) is a powerful learning approach for graph-based recommender
systems. Recently, GNNs integrated with contrastive learning have shown superior …

Hard sample aware network for contrastive deep graph clustering

Y Liu, X Yang, S Zhou, X Liu, Z Wang, K Liang… - Proceedings of the …, 2023 - ojs.aaai.org
Contrastive deep graph clustering, which aims to divide nodes into disjoint groups via
contrastive mechanisms, is a challenging research spot. Among the recent works, hard …

Cluster-guided contrastive graph clustering network

X Yang, Y Liu, S Zhou, S Wang, W Tu… - Proceedings of the …, 2023 - ojs.aaai.org
Benefiting from the intrinsic supervision information exploitation capability, contrastive
learning has achieved promising performance in the field of deep graph clustering recently …

Condensing graphs via one-step gradient matching

W Jin, X Tang, H Jiang, Z Li, D Zhang, J Tang… - Proceedings of the 28th …, 2022 - dl.acm.org
As training deep learning models on large dataset takes a lot of time and resources, it is
desired to construct a small synthetic dataset with which we can train deep learning models …

Dive into the details of self-supervised learning for medical image analysis

C Zhang, H Zheng, Y Gu - Medical Image Analysis, 2023 - Elsevier
Self-supervised learning (SSL) has achieved remarkable performance in various medical
imaging tasks by dint of priors from massive unlabeled data. However, regarding a specific …

ECOD: Unsupervised Outlier Detection Using Empirical Cumulative Distribution Functions

Z Li, Y Zhao, X Hu, N Botta, C Ionescu… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Outlier detection refers to the identification of data points that deviate from a general data
distribution. Existing unsupervised approaches often suffer from high computational cost …

Graph trend filtering networks for recommendation

W Fan, X Liu, W Jin, X Zhao, J Tang, Q Li - Proceedings of the 45th …, 2022 - dl.acm.org
Recommender systems aim to provide personalized services to users and are playing an
increasingly important role in our daily lives. The key of recommender systems is to predict …

Unsupervised graph neural architecture search with disentangled self-supervision

Z Zhang, X Wang, Z Zhang, G Shen… - Advances in Neural …, 2024 - proceedings.neurips.cc
The existing graph neural architecture search (GNAS) methods heavily rely on supervised
labels during the search process, failing to handle ubiquitous scenarios where supervisions …