Large language models on graphs: A comprehensive survey

B Jin, G Liu, C Han, M Jiang, H Ji… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Large language models (LLMs), such as GPT4 and LLaMA, are creating significant
advancements in natural language processing, due to their strong text encoding/decoding …

A survey of graph meets large language model: Progress and future directions

Y Li, Z Li, P Wang, J Li, X Sun, H Cheng… - arXiv preprint arXiv …, 2023 - arxiv.org
Graph plays a significant role in representing and analyzing complex relationships in real-
world applications such as citation networks, social networks, and biological data. Recently …

[HTML][HTML] Combined scaling for zero-shot transfer learning

H Pham, Z Dai, G Ghiasi, K Kawaguchi, H Liu, AW Yu… - Neurocomputing, 2023 - Elsevier
Recent developments in multimodal training methodologies, including CLIP and ALIGN,
obviate the necessity for individual data labeling. These approaches utilize pairs of data and …

Protst: Multi-modality learning of protein sequences and biomedical texts

M Xu, X Yuan, S Miret, J Tang - International Conference on …, 2023 - proceedings.mlr.press
Current protein language models (PLMs) learn protein representations mainly based on
their sequences, thereby well capturing co-evolutionary information, but they are unable to …

Shaping the water-harvesting behavior of metal–organic frameworks aided by fine-tuned GPT models

Z Zheng, AH Alawadhi, S Chheda… - Journal of the …, 2023 - ACS Publications
We construct a data set of metal–organic framework (MOF) linkers and employ a fine-tuned
GPT assistant to propose MOF linker designs by mutating and modifying the existing linker …

Enhancing activity prediction models in drug discovery with the ability to understand human language

P Seidl, A Vall, S Hochreiter… - … on Machine Learning, 2023 - proceedings.mlr.press
Activity and property prediction models are the central workhorses in drug discovery and
materials sciences, but currently, they have to be trained or fine-tuned for new tasks. Without …

A survey on rag meeting llms: Towards retrieval-augmented large language models

W Fan, Y Ding, L Ning, S Wang, H Li, D Yin… - Proceedings of the 30th …, 2024 - dl.acm.org
As one of the most advanced techniques in AI, Retrieval-Augmented Generation (RAG) can
offer reliable and up-to-date external knowledge, providing huge convenience for numerous …

Artificial intelligence for science in quantum, atomistic, and continuum systems

X Zhang, L Wang, J Helwig, Y Luo, C Fu, Y Xie… - arXiv preprint arXiv …, 2023 - arxiv.org
Advances in artificial intelligence (AI) are fueling a new paradigm of discoveries in natural
sciences. Today, AI has started to advance natural sciences by improving, accelerating, and …

Empowering molecule discovery for molecule-caption translation with large language models: A chatgpt perspective

J Li, Y Liu, W Fan, XY Wei, H Liu… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Molecule discovery plays a crucial role in various scientific fields, advancing the design of
tailored materials and drugs, which contributes to the development of society and human …

Git-mol: A multi-modal large language model for molecular science with graph, image, and text

P Liu, Y Ren, J Tao, Z Ren - Computers in biology and medicine, 2024 - Elsevier
Large language models have made significant strides in natural language processing,
enabling innovative applications in molecular science by processing textual representations …