Challenges and applications of large language models

J Kaddour, J Harris, M Mozes, H Bradley… - arXiv preprint arXiv …, 2023 - arxiv.org
Large Language Models (LLMs) went from non-existent to ubiquitous in the machine
learning discourse within a few years. Due to the fast pace of the field, it is difficult to identify …

Machine learning-guided protein engineering

P Kouba, P Kohout, F Haddadi, A Bushuiev… - ACS …, 2023 - ACS Publications
Recent progress in engineering highly promising biocatalysts has increasingly involved
machine learning methods. These methods leverage existing experimental and simulation …

Genome-wide prediction of disease variant effects with a deep protein language model

N Brandes, G Goldman, CH Wang, CJ Ye, V Ntranos - Nature Genetics, 2023 - nature.com
Predicting the effects of coding variants is a major challenge. While recent deep-learning
models have improved variant effect prediction accuracy, they cannot analyze all coding …

[HTML][HTML] Progen2: exploring the boundaries of protein language models

E Nijkamp, JA Ruffolo, EN Weinstein, N Naik, A Madani - Cell systems, 2023 - cell.com
Attention-based models trained on protein sequences have demonstrated incredible
success at classification and generation tasks relevant for artificial-intelligence-driven …

Sequence modeling and design from molecular to genome scale with Evo

E Nguyen, M Poli, MG Durrant, B Kang, D Katrekar… - Science, 2024 - science.org
The genome is a sequence that encodes the DNA, RNA, and proteins that orchestrate an
organism's function. We present Evo, a long-context genomic foundation model with a …

<? sty\usepackage {wasysym}?> Bilingual language model for protein sequence and structure

M Heinzinger, K Weissenow… - NAR Genomics and …, 2024 - academic.oup.com
Adapting language models to protein sequences spawned the development of powerful
protein language models (pLMs). Concurrently, AlphaFold2 broke through in protein …

Can language models be used for real-world urban-delivery route optimization?

Y Liu, F Wu, Z Liu, K Wang, F Wang, X Qu - The Innovation, 2023 - cell.com
Language models have contributed to breakthroughs in interdisciplinary research, such as
protein design and molecular dynamics understanding. In this study, we reveal that beyond …

Computational and artificial intelligence-based methods for antibody development

J Kim, M McFee, Q Fang, O Abdin, PM Kim - Trends in pharmacological …, 2023 - cell.com
Due to their high target specificity and binding affinity, therapeutic antibodies are currently
the largest class of biotherapeutics. The traditional largely empirical antibody development …

Self-play reinforcement learning guides protein engineering

Y Wang, H Tang, L Huang, L Pan, L Yang… - Nature Machine …, 2023 - nature.com
Designing protein sequences towards desired properties is a fundamental goal of protein
engineering, with applications in drug discovery and enzymatic engineering. Machine …

Unsupervised evolution of protein and antibody complexes with a structure-informed language model

VR Shanker, TUJ Bruun, BL Hie, PS Kim - Science, 2024 - science.org
Large language models trained on sequence information alone can learn high-level
principles of protein design. However, beyond sequence, the three-dimensional structures of …