AmelieSchreiber commited on
Commit
9630065
·
1 Parent(s): ff7ee86

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +24 -2
README.md CHANGED
@@ -5,18 +5,40 @@ library_name: peft
5
  ## Training procedure
6
 
7
  Generalization capabilities based on [this notebook](https://huggingface.co/AmelieSchreiber/esm2_t12_35M_lora_binding_sites_770K_v1/blob/main/esmbind-validation-struct.ipynb)
8
- are still lacking. The average metrics on the train datasets from the paper linked to in the notebook are:
9
 
 
 
 
 
 
 
 
 
 
 
10
  ```
 
 
 
 
 
11
  Average Accuracy: 0.9169
12
  Average Precision: 0.1416
13
  Average Recall: 0.2769
14
  Average F1 Score: 0.1743
15
  Average AUC: 0.6088
16
  Average MCC: 0.1522
 
 
 
 
 
 
 
 
17
  ```
18
 
19
- The average metrics on the test datasets provided by the paper are very similar.
20
 
21
  ### Framework versions
22
 
 
5
  ## Training procedure
6
 
7
  Generalization capabilities based on [this notebook](https://huggingface.co/AmelieSchreiber/esm2_t12_35M_lora_binding_sites_770K_v1/blob/main/esmbind-validation-struct.ipynb)
8
+ are still lacking.
9
 
10
+ Test Metrics:
11
+
12
+ ```python
13
+ 'eval_loss': 0.4365999102592468,
14
+ 'eval_accuracy': 0.9420512498988455,
15
+ 'eval_precision': 0.2294216317399737,
16
+ 'eval_recall': 0.7584797572261781,
17
+ 'eval_f1': 0.35228549223252686,
18
+ 'eval_auc': 0.8522129916967822,
19
+ 'eval_mcc': 0.39725936154292724,
20
  ```
21
+
22
+ The metrics on the train and test datasets from the paper mentioned in the notebook are:
23
+
24
+ ```python
25
+ Train metrics:
26
  Average Accuracy: 0.9169
27
  Average Precision: 0.1416
28
  Average Recall: 0.2769
29
  Average F1 Score: 0.1743
30
  Average AUC: 0.6088
31
  Average MCC: 0.1522
32
+
33
+ Test metrics:
34
+ Average Accuracy: 0.9199
35
+ Average Precision: 0.1307
36
+ Average Recall: 0.2750
37
+ Average F1 Score: 0.1677
38
+ Average AUC: 0.6081
39
+ Average MCC: 0.1474
40
  ```
41
 
 
42
 
43
  ### Framework versions
44