A comprehensive survey on pretrained foundation models: A history from bert to chatgpt
Pretrained Foundation Models (PFMs) are regarded as the foundation for various
downstream tasks with different data modalities. A PFM (eg, BERT, ChatGPT, and GPT-4) is …
downstream tasks with different data modalities. A PFM (eg, BERT, ChatGPT, and GPT-4) is …
Machine learning methods for small data challenges in molecular science
B Dou, Z Zhu, E Merkurjev, L Ke, L Chen… - Chemical …, 2023 - ACS Publications
Small data are often used in scientific and engineering research due to the presence of
various constraints, such as time, cost, ethics, privacy, security, and technical limitations in …
various constraints, such as time, cost, ethics, privacy, security, and technical limitations in …
[HTML][HTML] Graph neural networks for materials science and chemistry
Abstract Machine learning plays an increasingly important role in many areas of chemistry
and materials science, being used to predict materials properties, accelerate simulations …
and materials science, being used to predict materials properties, accelerate simulations …
[HTML][HTML] Multi-omics single-cell data integration and regulatory inference with graph-linked embedding
ZJ Cao, G Gao - Nature Biotechnology, 2022 - nature.com
Despite the emergence of experimental methods for simultaneous measurement of multiple
omics modalities in single cells, most single-cell datasets include only one modality. A major …
omics modalities in single cells, most single-cell datasets include only one modality. A major …
Graph representation learning in biomedicine and healthcare
Networks—or graphs—are universal descriptors of systems of interacting elements. In
biomedicine and healthcare, they can represent, for example, molecular interactions …
biomedicine and healthcare, they can represent, for example, molecular interactions …
The evolution of distributed systems for graph neural networks and their origin in graph processing and deep learning: A survey
Graph neural networks (GNNs) are an emerging research field. This specialized deep
neural network architecture is capable of processing graph structured data and bridges the …
neural network architecture is capable of processing graph structured data and bridges the …
Graph neural networks: foundation, frontiers and applications
The field of graph neural networks (GNNs) has seen rapid and incredible strides over the
recent years. Graph neural networks, also known as deep learning on graphs, graph …
recent years. Graph neural networks, also known as deep learning on graphs, graph …
Data augmentation for deep graph learning: A survey
Graph neural networks, a powerful deep learning tool to model graph-structured data, have
demonstrated remarkable performance on numerous graph learning tasks. To address the …
demonstrated remarkable performance on numerous graph learning tasks. To address the …
Graph contrastive learning automated
Self-supervised learning on graph-structured data has drawn recent interest for learning
generalizable, transferable and robust representations from unlabeled graphs. Among …
generalizable, transferable and robust representations from unlabeled graphs. Among …
Simgrace: A simple framework for graph contrastive learning without data augmentation
Graph contrastive learning (GCL) has emerged as a dominant technique for graph
representation learning which maximizes the mutual information between paired graph …
representation learning which maximizes the mutual information between paired graph …