AmelieSchreiber
commited on
Commit
·
9630065
1
Parent(s):
ff7ee86
Update README.md
Browse files
README.md
CHANGED
@@ -5,18 +5,40 @@ library_name: peft
|
|
5 |
## Training procedure
|
6 |
|
7 |
Generalization capabilities based on [this notebook](https://huggingface.co/AmelieSchreiber/esm2_t12_35M_lora_binding_sites_770K_v1/blob/main/esmbind-validation-struct.ipynb)
|
8 |
-
are still lacking.
|
9 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
10 |
```
|
|
|
|
|
|
|
|
|
|
|
11 |
Average Accuracy: 0.9169
|
12 |
Average Precision: 0.1416
|
13 |
Average Recall: 0.2769
|
14 |
Average F1 Score: 0.1743
|
15 |
Average AUC: 0.6088
|
16 |
Average MCC: 0.1522
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
17 |
```
|
18 |
|
19 |
-
The average metrics on the test datasets provided by the paper are very similar.
|
20 |
|
21 |
### Framework versions
|
22 |
|
|
|
5 |
## Training procedure
|
6 |
|
7 |
Generalization capabilities based on [this notebook](https://huggingface.co/AmelieSchreiber/esm2_t12_35M_lora_binding_sites_770K_v1/blob/main/esmbind-validation-struct.ipynb)
|
8 |
+
are still lacking.
|
9 |
|
10 |
+
Test Metrics:
|
11 |
+
|
12 |
+
```python
|
13 |
+
'eval_loss': 0.4365999102592468,
|
14 |
+
'eval_accuracy': 0.9420512498988455,
|
15 |
+
'eval_precision': 0.2294216317399737,
|
16 |
+
'eval_recall': 0.7584797572261781,
|
17 |
+
'eval_f1': 0.35228549223252686,
|
18 |
+
'eval_auc': 0.8522129916967822,
|
19 |
+
'eval_mcc': 0.39725936154292724,
|
20 |
```
|
21 |
+
|
22 |
+
The metrics on the train and test datasets from the paper mentioned in the notebook are:
|
23 |
+
|
24 |
+
```python
|
25 |
+
Train metrics:
|
26 |
Average Accuracy: 0.9169
|
27 |
Average Precision: 0.1416
|
28 |
Average Recall: 0.2769
|
29 |
Average F1 Score: 0.1743
|
30 |
Average AUC: 0.6088
|
31 |
Average MCC: 0.1522
|
32 |
+
|
33 |
+
Test metrics:
|
34 |
+
Average Accuracy: 0.9199
|
35 |
+
Average Precision: 0.1307
|
36 |
+
Average Recall: 0.2750
|
37 |
+
Average F1 Score: 0.1677
|
38 |
+
Average AUC: 0.6081
|
39 |
+
Average MCC: 0.1474
|
40 |
```
|
41 |
|
|
|
42 |
|
43 |
### Framework versions
|
44 |
|