Transformers in single-cell omics: a review and new perspectives

A Szałata, K Hrovatin, S Becker, A Tejada-Lapuerta… - Nature …, 2024 - nature.com
Recent efforts to construct reference maps of cellular phenotypes have expanded the
volume and diversity of single-cell omics data, providing an unprecedented resource for …

Profiling cell identity and tissue architecture with single-cell and spatial transcriptomics

GS Gulati, JP D'Silva, Y Liu, L Wang… - … Reviews Molecular Cell …, 2024 - nature.com
Single-cell transcriptomics has broadened our understanding of cellular diversity and gene
expression dynamics in healthy and diseased tissues. Recently, spatial transcriptomics has …

Assessing the limits of zero-shot foundation models in single-cell biology

KZ Kedzierska, L Crawford, AP Amini, AX Lu - bioRxiv, 2023 - biorxiv.org
The advent and success of foundation models such as GPT has sparked growing interest in
their application to single-cell biology. Models like Geneformer and scGPT have emerged …

Nicheformer: a foundation model for single-cell and spatial omics

AC Schaar, A Tejada-Lapuerta, G Palla, R Gutgesell… - bioRxiv, 2024 - biorxiv.org
Tissue makeup relies fundamentally on the cellular microenvironment. Spatial single-cell
genomics allows probing the underlying cellular interactions in an unbiased, scalable …

AttentionPert: accurately modeling multiplexed genetic perturbations with multi-scale effects

D Bai, CN Ellington, S Mo, L Song, EP Xing - Bioinformatics, 2024 - academic.oup.com
Motivation Genetic perturbations (eg knockouts, variants) have laid the foundation for our
understanding of many diseases, implicating pathogenic mechanisms and indicating …

Evaluating the Utilities of Foundation Models in Single-cell Data Analysis

T Liu, K Li, Y Wang, H Li, H Zhao - bioRxiv, 2023 - biorxiv.org
Abstract Large Language Models (LLMs) or foundation models have made significant
strides in both industrial and scientific domains. In this paper, we evaluate the performance …

AI-driven multi-omics integration for multi-scale predictive modeling of causal genotype-environment-phenotype relationships

Y Wu, L Xie - arXiv preprint arXiv:2407.06405, 2024 - arxiv.org
Despite the wealth of single-cell multi-omics data, it remains challenging to predict the
consequences of novel genetic and chemical perturbations in the human body. It requires …

How do large language models understand genes and cells

C Fang, Y Wang, Y Song, Q Long, W Lu… - ACM Transactions on …, 2024 - dl.acm.org
Researching genes and their interactions is crucial for deciphering the fundamental laws of
cellular activity, advancing disease treatment, drug discovery, and more. Large language …

Foundation models for bioinformatics

Z Chen, L Wei, G Gao - Quantitative Biology, 2024 - Wiley Online Library
Transformer‐based foundation models such as ChatGPTs have revolutionized our daily life
and affected many fields including bioinformatics. In this perspective, we first discuss about …

Current opinions on large cellular models.

M Hao, L Wei, F Yang, J Yao… - Quantitative …, 2024 - search.ebscohost.com
This document is an interview with leading researchers in the field of AI and biology,
discussing the development and applications of Large Cellular Models (LCMs) in biological …