Hugging Face's logo

tanishq1420
/
flan-t5-base-eLife

Text2Text Generation
Transformers
TensorBoard
Safetensors
t5
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Metrics Community
tanishq1420 commited on
Commit
313bad5
•
1 Parent(s): 2aced83

End of training

Browse files
Files changed (28) hide show
  1. README.md +13 -11
  2. logs/events.out.tfevents.1713983093.obelix +3 -0
  3. logs/events.out.tfevents.1713983520.obelix +3 -0
  4. logs/events.out.tfevents.1713983672.obelix +3 -0
  5. logs/events.out.tfevents.1713984358.obelix +3 -0
  6. logs/events.out.tfevents.1713984669.obelix +3 -0
  7. logs/events.out.tfevents.1713985081.obelix +3 -0
  8. logs/events.out.tfevents.1713985374.obelix +3 -0
  9. logs/events.out.tfevents.1713985516.obelix +3 -0
  10. logs/events.out.tfevents.1713987073.obelix +3 -0
  11. logs/events.out.tfevents.1713987425.obelix +3 -0
  12. logs/events.out.tfevents.1713987783.obelix +3 -0
  13. logs/events.out.tfevents.1713988467.obelix +3 -0
  14. logs/events.out.tfevents.1713988725.obelix +3 -0
  15. logs/events.out.tfevents.1713989159.obelix +3 -0
  16. logs/events.out.tfevents.1713989877.obelix +3 -0
  17. logs/events.out.tfevents.1713990070.obelix +3 -0
  18. logs/events.out.tfevents.1713990089.obelix +3 -0
  19. logs/events.out.tfevents.1713990105.obelix +3 -0
  20. logs/events.out.tfevents.1713990268.obelix +3 -0
  21. logs/events.out.tfevents.1713990276.obelix +3 -0
  22. logs/events.out.tfevents.1713990297.obelix +3 -0
  23. logs/events.out.tfevents.1713990407.obelix +3 -0
  24. logs/events.out.tfevents.1713992270.obelix +3 -0
  25. logs/events.out.tfevents.1713994199.obelix +3 -0
  26. model.safetensors +1 -1
  27. tokenizer.json +16 -2
  28. training_args.bin +1 -1
README.md CHANGED
@@ -17,12 +17,12 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.co/google/flan-t5-base) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 2.2332
21
- - Rouge1: 6.3927
22
- - Rouge2: 1.7293
23
- - Rougel: 5.2049
24
- - Rougelsum: 6.1098
25
- - Gen Len: 19.0
26
 
27
  ## Model description
28
 
@@ -41,19 +41,21 @@ More information needed
41
  ### Training hyperparameters
42
 
43
  The following hyperparameters were used during training:
44
- - learning_rate: 5e-05
45
  - train_batch_size: 8
46
  - eval_batch_size: 8
47
  - seed: 42
48
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
49
  - lr_scheduler_type: linear
50
- - num_epochs: 1
51
 
52
  ### Training results
53
 
54
- | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
55
- |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|
56
- | 2.4607 | 1.0 | 544 | 2.2332 | 6.3927 | 1.7293 | 5.2049 | 6.1098 | 19.0 |
 
 
57
 
58
 
59
  ### Framework versions
 
17
 
18
  This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.co/google/flan-t5-base) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 2.0883
21
+ - Rouge1: 0.3665
22
+ - Rouge2: 0.0826
23
+ - Rougel: 0.3524
24
+ - Bertscore: 0.8322
25
+ - Readability: 8.6631
26
 
27
  ## Model description
28
 
 
41
  ### Training hyperparameters
42
 
43
  The following hyperparameters were used during training:
44
+ - learning_rate: 0.0001
45
  - train_batch_size: 8
46
  - eval_batch_size: 8
47
  - seed: 42
48
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
49
  - lr_scheduler_type: linear
50
+ - num_epochs: 3
51
 
52
  ### Training results
53
 
54
+ | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Bertscore | Readability |
55
+ |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-----------:|
56
+ | 2.1756 | 1.0 | 544 | 2.1228 | 0.3665 | 0.0834 | 0.3529 | 0.8339 | 8.6929 |
57
+ | 2.1907 | 2.0 | 1088 | 2.0947 | 0.3545 | 0.0804 | 0.3418 | 0.8290 | 8.5141 |
58
+ | 2.1566 | 3.0 | 1632 | 2.0883 | 0.3665 | 0.0826 | 0.3524 | 0.8322 | 8.6631 |
59
 
60
 
61
  ### Framework versions
logs/events.out.tfevents.1713983093.obelix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:845425a2e85a4cb6f714fdd4729e46b7b77427ac65d2452af752140d846d4bb8
3
+ size 565
logs/events.out.tfevents.1713983520.obelix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd9a12a4cc72298e39d6ffa1f425516f353e73c13c76a7c59d6f3958f8dfbba4
3
+ size 10404
logs/events.out.tfevents.1713983672.obelix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:66da43696ce2f8c63e65da4586b80bfb5ec2ae09919d2e35bb7c12d510943e97
3
+ size 5222
logs/events.out.tfevents.1713984358.obelix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c0787d0acfad33700a2e8a230d44308352f65391de9a9a65a68c89808001d8a
3
+ size 488
logs/events.out.tfevents.1713984669.obelix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd47a2d5ac8835140e13279cb5467727c6f73fff483c237449cecf1c521295db
3
+ size 440
logs/events.out.tfevents.1713985081.obelix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ec3f06d66f8120b22ea2a02b8072f32c82be06400022a406acfe0d0922e90ba
3
+ size 440
logs/events.out.tfevents.1713985374.obelix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f270f01afb33b160aad50a0a206bf9c21918a3fb1ea2550f4b326efd325559b3
3
+ size 440
logs/events.out.tfevents.1713985516.obelix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cdf191e38c53b5666c7cf99958a9e6a5a5fa2de1ac3b8b801e793f4f1ff4ad63
3
+ size 440
logs/events.out.tfevents.1713987073.obelix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:46ba0037356de2b947f50d673e2d36dd244c6b7df35ce6aa330d3439b661b13e
3
+ size 440
logs/events.out.tfevents.1713987425.obelix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1fcd228a3db188b5a74c93d61da56757e512f8e63fc1681ebf356926d98f82b6
3
+ size 440
logs/events.out.tfevents.1713987783.obelix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:40f25890817b0cacd1234e1179366a9a84100c9473454b4504b9acc6d674a692
3
+ size 5593
logs/events.out.tfevents.1713988467.obelix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9a5339ca9d856c08ba8c2669916f11dabf23dbf761e6ff3ae246c34539141360
3
+ size 440
logs/events.out.tfevents.1713988725.obelix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b002b7937aeda76837e3a6f9d70eec39685b5b8c89b98548793ea94b45940dd4
3
+ size 440
logs/events.out.tfevents.1713989159.obelix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f43449a06a5bdd0bbe8e4afe34f87e9943d30a11a8981f3c5a0dce937854f9a6
3
+ size 6578
logs/events.out.tfevents.1713989877.obelix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dbe7cbd0fe806975cb7315f7b6940cc8468c77c77bf5435290797c47d9c94704
3
+ size 514
logs/events.out.tfevents.1713990070.obelix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a8d354cbc65fc2a497319e0c15cf8ef4104ba648e88041b3c48973fea48623fb
3
+ size 5222
logs/events.out.tfevents.1713990089.obelix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1a471fd0c7fa7ac876309a783445f82987a0a8d2a6c914925efe02f951f76755
3
+ size 10404
logs/events.out.tfevents.1713990105.obelix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3b46026df042c34d97aa1c4907d60fd4c91c1c7bd83479bcb64657ea75fffe04
3
+ size 5222
logs/events.out.tfevents.1713990268.obelix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a1a67190c2f80395ac5f7badb91b19106afc8efcab9fa535ea21b9ce8703bddc
3
+ size 3595
logs/events.out.tfevents.1713990276.obelix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:622412ffe46bce24b9967d362d7a13074cdd027517e9c0c31daf01ae4d219e6e
3
+ size 13959
logs/events.out.tfevents.1713990297.obelix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c4361ca5d17a6a3c172ae0797e380088e5131e50fa18c8e726f8eb7468f6f22
3
+ size 3595
logs/events.out.tfevents.1713990407.obelix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:99e699be40906261b5f27666de14ece8045def6b0b1ab3331846a6335ecca506
3
+ size 5351
logs/events.out.tfevents.1713992270.obelix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:861b0456dca14177b39135f0d70cb220c7852a6277cc8ea9e7918b2681b41d56
3
+ size 7606
logs/events.out.tfevents.1713994199.obelix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b30ab76cf861ea76f5660eaf0f679635eaf04e7fad3b0f81c22924c3f3d01472
3
+ size 569
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:eabeab662bb694f238c19bf6a79165685133931d87af3ab0c772be2e41499199
3
  size 990345064
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3aff89fbdd39876d22e18ea33d96f2d941c65fd3f3c7de482e7c2a29c03c4ca7
3
  size 990345064
tokenizer.json CHANGED
@@ -1,7 +1,21 @@
1
  {
2
  "version": "1.0",
3
- "truncation": null,
4
- "padding": null,
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  "added_tokens": [
6
  {
7
  "id": 0,
 
1
  {
2
  "version": "1.0",
3
+ "truncation": {
4
+ "direction": "Right",
5
+ "max_length": 512,
6
+ "strategy": "LongestFirst",
7
+ "stride": 0
8
+ },
9
+ "padding": {
10
+ "strategy": {
11
+ "Fixed": 512
12
+ },
13
+ "direction": "Right",
14
+ "pad_to_multiple_of": null,
15
+ "pad_id": 0,
16
+ "pad_type_id": 0,
17
+ "pad_token": "<pad>"
18
+ },
19
  "added_tokens": [
20
  {
21
  "id": 0,
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:990a942dd3108ea5eb70b4f2c82a11d9abc4cb68d4e02f0a51d8f0f086886ac9
3
  size 4728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cdef98433bce6d20f29bd1073cdf733867dd9305b1245b69d4c0472f9317043a
3
  size 4728