AmelieSchreiber
/

esm2_t6_8M_weighted_lora_rna_binding

protein language model

Model card Files Files and versions Community

AmelieSchreiber commited on Aug 9, 2023

Commit

94d457b

•

1 Parent(s): 7bb7235

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -28,6 +28,7 @@ using [this notebook](https://huggingface.co/AmelieSchreiber/esm2_t6_8M_weighted
 You just need the RNA `binding_sites.xml` file [found here](https://huggingface.co/datasets/AmelieSchreiber/data_of_protein-rna_binding_sites).
 A similar model can also be trained using the Github with a training script and conda env YAML, which can be
 [found here](https://github.com/Amelie-Schreiber/esm2_LoRA_binding_sites/tree/main). This version uses wandb sweeps for hyperparameter search.
 ```
 {'eval_loss': 0.49476009607315063,

 You just need the RNA `binding_sites.xml` file [found here](https://huggingface.co/datasets/AmelieSchreiber/data_of_protein-rna_binding_sites).
 A similar model can also be trained using the Github with a training script and conda env YAML, which can be
 [found here](https://github.com/Amelie-Schreiber/esm2_LoRA_binding_sites/tree/main). This version uses wandb sweeps for hyperparameter search.
+However, it does not use class weighting.
 ```
 {'eval_loss': 0.49476009607315063,