AmelieSchreiber
/

esm2_t6_8M_binding_sites_finetune_600K

Token Classification

Inference Endpoints

Model card Files Files and versions Community

AmelieSchreiber commited on Oct 8, 2023

Commit

9d68f13

•

1 Parent(s): 0def08a

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -6,7 +6,8 @@ license: mit
 This model is a full finetune of ESM-2, to illustrate how full finetuning overfits and generalizes quite poorly compared to
 LoRA and QLoRA finetuning. This model was finetuned on the 600K dataset. We also note that on the 24GB A10 GPU, the batch size
-has to be significantly smaller.
 ```python
 Train metrics:

 This model is a full finetune of ESM-2, to illustrate how full finetuning overfits and generalizes quite poorly compared to
 LoRA and QLoRA finetuning. This model was finetuned on the 600K dataset. We also note that on the 24GB A10 GPU, the batch size
+has to be significantly smaller. To finetune a similar model, use
+[this script](https://huggingface.co/AmelieSchreiber/esm2_t6_8M_binding_sites_finetune/blob/main/finetune.py).
 ```python
 Train metrics: