biololab commited on
Commit
96155a7
1 Parent(s): ac67c6c

End of training

Browse files
README.md ADDED
@@ -0,0 +1,72 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ base_model: flax-community/spanish-t5-small
4
+ tags:
5
+ - generated_from_trainer
6
+ metrics:
7
+ - rouge
8
+ model-index:
9
+ - name: clinical_document_summarization
10
+ results: []
11
+ ---
12
+
13
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
+ should probably proofread and complete it, then remove this comment. -->
15
+
16
+ # clinical_document_summarization
17
+
18
+ This model is a fine-tuned version of [flax-community/spanish-t5-small](https://huggingface.co/flax-community/spanish-t5-small) on an unknown dataset.
19
+ It achieves the following results on the evaluation set:
20
+ - Loss: 0.4429
21
+ - Rouge1: 0.3814
22
+ - Rouge2: 0.3162
23
+ - Rougel: 0.3727
24
+ - Rougelsum: 0.3727
25
+ - Gen Len: 19.0
26
+
27
+ ## Model description
28
+
29
+ More information needed
30
+
31
+ ## Intended uses & limitations
32
+
33
+ More information needed
34
+
35
+ ## Training and evaluation data
36
+
37
+ More information needed
38
+
39
+ ## Training procedure
40
+
41
+ ### Training hyperparameters
42
+
43
+ The following hyperparameters were used during training:
44
+ - learning_rate: 2e-05
45
+ - train_batch_size: 16
46
+ - eval_batch_size: 16
47
+ - seed: 42
48
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
49
+ - lr_scheduler_type: linear
50
+ - num_epochs: 8
51
+ - mixed_precision_training: Native AMP
52
+
53
+ ### Training results
54
+
55
+ | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
56
+ |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|
57
+ | 0.9449 | 1.0 | 592 | 0.6076 | 0.3739 | 0.303 | 0.3633 | 0.3632 | 18.9996 |
58
+ | 0.6902 | 2.0 | 1184 | 0.5278 | 0.3771 | 0.3101 | 0.3686 | 0.3685 | 19.0 |
59
+ | 0.601 | 3.0 | 1776 | 0.4962 | 0.3797 | 0.3143 | 0.3721 | 0.3721 | 19.0 |
60
+ | 0.568 | 4.0 | 2368 | 0.4721 | 0.3792 | 0.3134 | 0.3701 | 0.3701 | 19.0 |
61
+ | 0.5334 | 5.0 | 2960 | 0.4597 | 0.3795 | 0.3143 | 0.3713 | 0.3713 | 19.0 |
62
+ | 0.4968 | 6.0 | 3552 | 0.4496 | 0.3816 | 0.3165 | 0.3729 | 0.3729 | 19.0 |
63
+ | 0.4873 | 7.0 | 4144 | 0.4449 | 0.3812 | 0.316 | 0.3726 | 0.3726 | 19.0 |
64
+ | 0.4794 | 8.0 | 4736 | 0.4429 | 0.3814 | 0.3162 | 0.3727 | 0.3727 | 19.0 |
65
+
66
+
67
+ ### Framework versions
68
+
69
+ - Transformers 4.38.2
70
+ - Pytorch 2.1.0+cu121
71
+ - Datasets 2.18.0
72
+ - Tokenizers 0.15.2
generation_config.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "decoder_start_token_id": 0,
3
+ "eos_token_id": 1,
4
+ "pad_token_id": 0,
5
+ "transformers_version": "4.38.2"
6
+ }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:60f1a65d108eba31d7dee0401253af3066fab50cb00bb92d331cfd122938c466
3
  size 241990696
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:791b286003e646a19edd46514d44aba53625c19dd66f1447c14a3d14bfbe5549
3
  size 241990696
runs/Mar09_16-37-29_0d0cd5a60026/events.out.tfevents.1710002250.0d0cd5a60026.1084.2 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9e6b4fffdf69dd82fda365d83f72ef8b6d199c048846d6fe033448af3e1cd1ef
3
- size 10485
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc1a3b33e6aed294e3abe2d043b06e16262648fe7067dc2f13f40e2f6e42563d
3
+ size 12100