A comprehensive survey on pretrained foundation models: A history from bert to chatgpt
Abstract Pretrained Foundation Models (PFMs) are regarded as the foundation for various
downstream tasks across different data modalities. A PFM (eg, BERT, ChatGPT, GPT-4) is …
downstream tasks across different data modalities. A PFM (eg, BERT, ChatGPT, GPT-4) is …
Towards data-centric graph machine learning: Review and outlook
Data-centric AI, with its primary focus on the collection, management, and utilization of data
to drive AI models and applications, has attracted increasing attention in recent years. In this …
to drive AI models and applications, has attracted increasing attention in recent years. In this …
LightGCL: Simple yet effective graph contrastive learning for recommendation
Graph neural network (GNN) is a powerful learning approach for graph-based recommender
systems. Recently, GNNs integrated with contrastive learning have shown superior …
systems. Recently, GNNs integrated with contrastive learning have shown superior …
Hard sample aware network for contrastive deep graph clustering
Contrastive deep graph clustering, which aims to divide nodes into disjoint groups via
contrastive mechanisms, is a challenging research spot. Among the recent works, hard …
contrastive mechanisms, is a challenging research spot. Among the recent works, hard …
Cluster-guided contrastive graph clustering network
Benefiting from the intrinsic supervision information exploitation capability, contrastive
learning has achieved promising performance in the field of deep graph clustering recently …
learning has achieved promising performance in the field of deep graph clustering recently …
Condensing graphs via one-step gradient matching
As training deep learning models on large dataset takes a lot of time and resources, it is
desired to construct a small synthetic dataset with which we can train deep learning models …
desired to construct a small synthetic dataset with which we can train deep learning models …
Dive into the details of self-supervised learning for medical image analysis
Self-supervised learning (SSL) has achieved remarkable performance in various medical
imaging tasks by dint of priors from massive unlabeled data. However, regarding a specific …
imaging tasks by dint of priors from massive unlabeled data. However, regarding a specific …
ECOD: Unsupervised Outlier Detection Using Empirical Cumulative Distribution Functions
Outlier detection refers to the identification of data points that deviate from a general data
distribution. Existing unsupervised approaches often suffer from high computational cost …
distribution. Existing unsupervised approaches often suffer from high computational cost …
Graph trend filtering networks for recommendation
Recommender systems aim to provide personalized services to users and are playing an
increasingly important role in our daily lives. The key of recommender systems is to predict …
increasingly important role in our daily lives. The key of recommender systems is to predict …
Unsupervised graph neural architecture search with disentangled self-supervision
The existing graph neural architecture search (GNAS) methods heavily rely on supervised
labels during the search process, failing to handle ubiquitous scenarios where supervisions …
labels during the search process, failing to handle ubiquitous scenarios where supervisions …