File size: 887 Bytes
aaf9a40 46c5afc aaf9a40 1a08e3c 1eacc7c aaf9a40 0adef41 aaf9a40 ec8d3c5 aaf9a40 ec8d3c5 46c5afc ec8d3c5 46c5afc ec8d3c5 46c5afc ec8d3c5 aaf9a40 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 |
---
library_name: peft
base_model: westlake-repl/SaProt_35M_AF2
---
**Base model:** [westlake-repl/SaProt_35M_AF2](https://huggingface.co/westlake-repl/SaProt_35M_AF2)
**Task type:** Protein-protein Regression
## Model Details
### Model Description
<!-- Provide a longer summary of what this model is. -->
This model is used to predict TM score give two SA protein pairs.
### Model input type
SA sequence pair
### Performance
test_loss: 0.0031981547363102436
test_spearman: 0.8464066386222839
test_R2: 0.8718534111976624
test_pearson: 0.9338204860687256
### LoRA config
lora_dropout: 0.0
lora_alpha: 16
target_modules: ["query", "key", "value", "intermediate.dense", "output.dense"]
modules_to_save: ["classifier"]
### Training config
class: AdamW
betas: (0.9, 0.98)
weight_decay: 0.01
learning rate: 1e-4
epoch: 10
batch size: 4
precision: 16-mixed
- PEFT 0.10.0 |