ESMFold2

Pre-trained models for all-atom structure prediction and gradient-based protein binder design.

Disclaimer

This is an UNOFFICIAL implementation of the Language Modeling Materializes a World Model of Protein Biology by Salvatore Candido, et al.

The OFFICIAL repository of ESMFold2 is at Biohub/esm.

The team releasing ESMFold2 did not write this model card for this model so this model card has been written by the OFoldX team.

Model Details

ESMFold2 uses a frozen ESMC language model to supply sequence representations to a recurrent folding trunk. A diffusion head generates atomic coordinates, and distogram and confidence heads score the prediction. Supported checkpoints also accept protein MSA evidence. Experimental variants expose differentiable inversion for protein binder sequence design.

Please refer to the Training Details section for more information on the training process.

Variants

Model Specification

Variant Folding Blocks MSA ESMC Single Size Pair Size Atom Size Token Size Recurrent Updates Sampling Steps Num Parameters (M)
ESMFold2 48 yes 6B 384 256 128 768 4 14 6579.742
ESMFold2 Fast 24 no 6B 384 256 128 768 4 14 6533.723
Experimental 48 yes 6B 384 256 128 768 4 14 6577.328
Experimental Fast 24 no 6B 384 256 128 768 4 14 6530.863

Parameter counts include the frozen ESMC encoder.

Links

  • Code: ofoldx.models.esmfold2
  • Paper: Language Modeling Materializes a World Model of Protein Biology
  • Developed by: Salvatore Candido, Thomas Hayes, Alexander Derry, Roshan Rao, Zeming Lin, Robert Verkuil, Bryan Wu, Jin Sub Lee, Elise S. Bruguera, Jehan A. Keval, Mykhailo Kopylov, John E. Pak, Wesley Wu, Neil Thomas, Samson Mataraso, Alvin Hsu, Ashton C. Trotman-Grant, Kilian Fatras, Allan dos Santos Costa, Rohil Badkundri, Halil Akın, Deniz Oktay, Jonathan Deaton, Elizabeth Montabana, Hrishita Sitwala, Yue Yu, Marius Wiggert, Dylan Alexander Carlin, Anthony W. Goering, Tomasz Blazejewski, McCullen Sandora, Michael Hla, Tina Z. Jia, Leon H. Kloker, Nicholas J. Sofroniew, Masatoshi Uehara, Jassi Pannu, Sharrol Bachas, Daniel S. Liu, Tom Sercu, and Alexander Rives
  • Model type: ESMC-conditioned recurrent all-atom folding model with diffusion coordinate generation
  • Original Repository: Biohub/esm

Usage

The model file depends on the ofoldx library. You can install it using pip:

pip install ofoldx

Direct Use

Structure Prediction

You can use this model directly with a pipeline for all-atom structure prediction:

import ofoldx
from ofoldx.io import read_structure

structure, report = read_structure("input.cif")
pipeline = ofoldx.pipeline("fold", model="oteam/esmfold2")
result = pipeline(structure, seed=7)

The result contains predicted structures and confidence values. The standard and Fast models share the frozen MultiMolecule ESMC-6B checkpoint; its exact revision is recorded in the model configuration and downloaded through the Hugging Face cache. Protein sequences are also accepted directly.

Binder Design

You can use this model directly with a pipeline for experimental binder sequence optimization:

import ofoldx

pipeline = ofoldx.pipeline("design", model="oteam/esmfold2-experimental")
result = pipeline("MKTAYIAKQRQISFVKSHFSRQ", num_binder_residues=80, seed=7)

The workflow optimizes binder sequences with gradients and ranks candidates using folding predictions. It requires the full experimental repository, including when scaling critics are disabled. Antibody designs are detected automatically unless is_antibody is specified. Antibody detection and CDR scoring use ANARCI and require HMMER's hmmscan executable on PATH.

Training Details

ESMFold2 combines pretrained folding models with learned confidence and scaling components for structure prediction.

Training Data

Biohub reports training on Protein Data Bank (PDB) and AlphaFold DB (AFDB) data, with a September 2021 cutoff for ESMFold2 and ESMFold2-Fast. ESMC was pretrained separately; consult its model card for the sequence corpus.

Training Procedure

ESMFold2 is trained with diffusion, distogram, and confidence objectives for all-atom structure prediction.

Citation

@misc{candido2026language,
  title = {Language Modeling Materializes a World Model of Protein Biology},
  author = {Candido, Salvatore and Hayes, Thomas and Derry, Alexander and others},
  year = {2026},
  url = {https://biohub.ai/papers/esm_protein.pdf},
  note = {Preprint}
}

The artifacts distributed in this repository are part of the OFoldX project. If OFoldX supports your research, please cite the OFoldX project as follows:

@software{chen2026ofoldx,
  author = {Chen, Zhiyuan},
  title  = {OFoldX},
  year   = {2026},
  url    = {https://github.com/OTeam-AI4S/OFoldX},
}

Contact

Please use GitHub issues of OFoldX for any questions or comments on the model implementation or model card.

Please contact the authors of the ESMFold2 paper for questions or comments on the paper/model.

License

The model weights, implementation, configuration, and documentation distributed by OFoldX are licensed under the GNU Affero General Public License.

For additional terms and clarifications, please refer to our License FAQ.

SPDX-License-Identifier: AGPL-3.0-or-later
Downloads last month

-

Downloads are not tracked for this model. How to track
Safetensors
Model size
0.2B params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support