We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Quantitative Biology > Quantitative Methods

Title: Exploring evolution-aware & -free protein language models as protein function predictors

Abstract: Large-scale Protein Language Models (PLMs) have improved performance in protein prediction tasks, ranging from 3D structure prediction to various function predictions. In particular, AlphaFold, a ground-breaking AI system, could potentially reshape structural biology. However, the utility of the PLM module in AlphaFold, Evoformer, has not been explored beyond structure prediction. In this paper, we investigate the representation ability of three popular PLMs: ESM-1b (single sequence), MSA-Transformer (multiple sequence alignment) and Evoformer (structural), with a special focus on Evoformer. Specifically, we aim to answer the following key questions: (i) Does the Evoformer trained as part of AlphaFold produce representations amenable to predicting protein function? (ii) If yes, can Evoformer replace ESM-1b and MSA-Transformer? (ii) How much do these PLMs rely on evolution-related protein data? In this regard, are they complementary to each other? We compare these models by empirical study along with new insights and conclusions. All code and datasets for reproducibility are available at this https URL
Subjects: Quantitative Methods (q-bio.QM); Artificial Intelligence (cs.AI)
Cite as: arXiv:2206.06583 [q-bio.QM]
  (or arXiv:2206.06583v2 [q-bio.QM] for this version)

Submission history

From: Fajie Yuan [view email]
[v1] Tue, 14 Jun 2022 03:56:10 GMT (5520kb,D)
[v2] Sun, 16 Oct 2022 10:00:24 GMT (7223kb,D)

Link back to: arXiv, form interface, contact.