Transformers in single-cell omics: a review and new perspectives

A Szałata, K Hrovatin, S Becker, A Tejada-Lapuerta… - Nature …, 2024 - nature.com
Recent efforts to construct reference maps of cellular phenotypes have expanded the
volume and diversity of single-cell omics data, providing an unprecedented resource for …

Profiling cell identity and tissue architecture with single-cell and spatial transcriptomics

GS Gulati, JP D'Silva, Y Liu, L Wang… - … Reviews Molecular Cell …, 2024 - nature.com
Single-cell transcriptomics has broadened our understanding of cellular diversity and gene
expression dynamics in healthy and diseased tissues. Recently, spatial transcriptomics has …

Universal cell embeddings: A foundation model for cell biology

Y Rosen, Y Roohani, A Agarwal, L Samotorčan… - bioRxiv, 2023 - biorxiv.org
Developing a universal representation of cells which encompasses the tremendous
molecular diversity of cell types within the human body and more generally, across species …

Assessing the limits of zero-shot foundation models in single-cell biology

KZ Kedzierska, L Crawford, AP Amini, AX Lu - bioRxiv, 2023 - biorxiv.org
The advent and success of foundation models such as GPT has sparked growing interest in
their application to single-cell biology. Models like Geneformer and scGPT have emerged …

Transformer-based single-cell language model: A survey

W Lan, G He, M Liu, Q Chen, J Cao… - Big Data Mining and …, 2024 - ieeexplore.ieee.org
The transformers have achieved significant accomplishments in the natural language
processing as its outstanding parallel processing capabilities and highly flexible attention …

Robust evaluation of deep learning-based representation methods for survival and gene essentiality prediction on bulk RNA-seq data

B Gross, A Dauvin, V Cabeli, V Kmetzsch… - Scientific Reports, 2024 - nature.com
Deep learning (DL) has shown potential to provide powerful representations of bulk RNA-
seq data in cancer research. However, there is no consensus regarding the impact of design …

Evaluating the Utilities of Foundation Models in Single-cell Data Analysis

T Liu, K Li, Y Wang, H Li, H Zhao - bioRxiv, 2023 - biorxiv.org
Abstract Large Language Models (LLMs) or foundation models have made significant
strides in both industrial and scientific domains. In this paper, we evaluate the performance …

[HTML][HTML] Large language models in bioinformatics: applications and perspectives

J Liu, M Yang, Y Yu, H Xu, K Li, X Zhou - ArXiv, 2024 - ncbi.nlm.nih.gov
Large language models (LLMs) are a class of artificial intelligence models based on deep
learning, which have great performance in various tasks, especially in natural language …

General-purpose pre-trained large cellular models for single-cell transcriptomics

H Bian, Y Chen, E Luo, X Wu, M Hao… - National Science …, 2024 - academic.oup.com
The great capability of AI large language models (LLMs) pre-trained on massive natural
language data has inspired scientists to develop a few …

Analyzing scRNA-seq data by CCP-assisted UMAP and tSNE

Y Hozumi, GW Wei - PloS one, 2024 - journals.plos.org
Single-cell RNA sequencing (scRNA-seq) is widely used to reveal heterogeneity in cells,
which has given us insights into cell-cell communication, cell differentiation, and differential …