Santarabantoosoo commited on
Commit
65cf290
1 Parent(s): 6f0e4e5

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -0
README.md CHANGED
@@ -12,6 +12,8 @@ should probably proofread and complete it, then remove this comment. -->
12
  # Clinical-Longformer-MLM-opnote
13
 
14
  This model is a fine-tuned version of [yikuan8/Clinical-Longformer](https://huggingface.co/yikuan8/Clinical-Longformer) on the None dataset.
 
 
15
 
16
  ## Model description
17
 
@@ -41,6 +43,15 @@ The following hyperparameters were used during training:
41
  - num_epochs: 3.0
42
  - mixed_precision_training: Native AMP
43
 
 
 
 
 
 
 
 
 
 
44
  ### Framework versions
45
 
46
  - Transformers 4.19.1
 
12
  # Clinical-Longformer-MLM-opnote
13
 
14
  This model is a fine-tuned version of [yikuan8/Clinical-Longformer](https://huggingface.co/yikuan8/Clinical-Longformer) on the None dataset.
15
+ It achieves the following results on the evaluation set:
16
+ - Loss: 0.8286
17
 
18
  ## Model description
19
 
 
43
  - num_epochs: 3.0
44
  - mixed_precision_training: Native AMP
45
 
46
+ ### Training results
47
+
48
+ | Training Loss | Epoch | Step | Validation Loss |
49
+ |:-------------:|:-----:|:----:|:---------------:|
50
+ | No log | 1.0 | 266 | 0.9606 |
51
+ | 1.1655 | 2.0 | 532 | 0.8677 |
52
+ | 1.1655 | 3.0 | 798 | 0.8195 |
53
+
54
+
55
  ### Framework versions
56
 
57
  - Transformers 4.19.1