Hugging Face's logo

alibidaran
/
t5-small-medical_transcription

Summarization
Transformers
PyTorch
TensorBoard
t5
text2text-generation
Generated from Trainer
Inference Endpoints
text-generation-inference
Model card Files Metrics Community
3
alibidaran commited on
Commit
5badafa
•
1 Parent(s): df4e881

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -15
README.md CHANGED
@@ -17,12 +17,12 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 1.7744
21
- - Rouge1: 0.3722
22
- - Rouge2: 0.2709
23
- - Rougel: 0.3628
24
- - Rougelsum: 0.3619
25
- - Gen Len: 17.0877
26
 
27
  ## Model description
28
 
@@ -47,20 +47,22 @@ The following hyperparameters were used during training:
47
  - seed: 42
48
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
49
  - lr_scheduler_type: linear
50
- - num_epochs: 8
51
 
52
  ### Training results
53
 
54
  | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
55
  |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|
56
- | 2.4475 | 1.0 | 27 | 2.0647 | 0.3288 | 0.2503 | 0.3252 | 0.3212 | 17.2281 |
57
- | 2.0319 | 2.0 | 54 | 1.9089 | 0.3456 | 0.2527 | 0.3407 | 0.3377 | 16.3684 |
58
- | 1.8772 | 3.0 | 81 | 1.8572 | 0.3528 | 0.2615 | 0.3478 | 0.3457 | 16.1579 |
59
- | 1.796 | 4.0 | 108 | 1.8211 | 0.3274 | 0.2479 | 0.324 | 0.3216 | 15.7719 |
60
- | 1.7107 | 5.0 | 135 | 1.7972 | 0.3689 | 0.277 | 0.3614 | 0.3586 | 16.3509 |
61
- | 1.711 | 6.0 | 162 | 1.7852 | 0.359 | 0.2599 | 0.3505 | 0.348 | 16.2105 |
62
- | 1.7581 | 7.0 | 189 | 1.7773 | 0.3659 | 0.2646 | 0.3566 | 0.3559 | 16.9298 |
63
- | 1.704 | 8.0 | 216 | 1.7744 | 0.3722 | 0.2709 | 0.3628 | 0.3619 | 17.0877 |
 
 
64
 
65
 
66
  ### Framework versions
 
17
 
18
  This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.2564
21
+ - Rouge1: 0.4958
22
+ - Rouge2: 0.419
23
+ - Rougel: 0.4803
24
+ - Rougelsum: 0.481
25
+ - Gen Len: 18.1147
26
 
27
  ## Model description
28
 
 
47
  - seed: 42
48
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
49
  - lr_scheduler_type: linear
50
+ - num_epochs: 10
51
 
52
  ### Training results
53
 
54
  | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
55
  |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|
56
+ | 0.8608 | 1.0 | 559 | 0.3784 | 0.4243 | 0.3455 | 0.4076 | 0.4084 | 17.7384 |
57
+ | 0.4157 | 2.0 | 1118 | 0.3419 | 0.4245 | 0.3503 | 0.4092 | 0.4101 | 17.8612 |
58
+ | 0.3736 | 3.0 | 1677 | 0.3110 | 0.4436 | 0.3699 | 0.4274 | 0.4282 | 18.1187 |
59
+ | 0.3491 | 4.0 | 2236 | 0.3016 | 0.4613 | 0.3882 | 0.4452 | 0.4465 | 18.163 |
60
+ | 0.3253 | 5.0 | 2795 | 0.2844 | 0.4702 | 0.3962 | 0.4542 | 0.4545 | 18.1187 |
61
+ | 0.3094 | 6.0 | 3354 | 0.2735 | 0.4767 | 0.403 | 0.4607 | 0.4612 | 18.1308 |
62
+ | 0.2983 | 7.0 | 3913 | 0.2652 | 0.4853 | 0.4099 | 0.4692 | 0.4699 | 18.0201 |
63
+ | 0.2908 | 8.0 | 4472 | 0.2601 | 0.494 | 0.4175 | 0.4775 | 0.4783 | 18.1247 |
64
+ | 0.2808 | 9.0 | 5031 | 0.2571 | 0.4954 | 0.4169 | 0.4799 | 0.4811 | 18.0926 |
65
+ | 0.2803 | 10.0 | 5590 | 0.2564 | 0.4958 | 0.419 | 0.4803 | 0.481 | 18.1147 |
66
 
67
 
68
  ### Framework versions