Hugging Face's logo

manahil1
/
Code_Corrector_Model

Text2Text Generation
Transformers
PyTorch
t5
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Community
1
manahil1 commited on
Commit
e7c95ce
·
1 Parent(s): 0a757c2

End of training

Browse files
Files changed (3) hide show
  1. README.md +104 -6
  2. pytorch_model.bin +2 -2
  3. training_args.bin +1 -1
README.md CHANGED
@@ -17,9 +17,9 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 9.7240
21
  - Bleu: 0.0
22
- - Gen Len: 19.0
23
 
24
  ## Model description
25
 
@@ -44,19 +44,117 @@ The following hyperparameters were used during training:
44
  - seed: 42
45
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
46
  - lr_scheduler_type: linear
47
- - num_epochs: 2
48
 
49
  ### Training results
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Bleu | Gen Len |
52
  |:-------------:|:-----:|:----:|:---------------:|:----:|:-------:|
53
- | 13.7281 | 1.0 | 1 | 9.8868 | 0.0 | 19.0 |
54
- | 14.0714 | 2.0 | 2 | 9.7240 | 0.0 | 19.0 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
55
 
56
 
57
  ### Framework versions
58
 
59
  - Transformers 4.33.0
60
- - Pytorch 2.0.0+cpu
61
  - Datasets 2.1.0
62
  - Tokenizers 0.13.3
 
17
 
18
  This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 1.2859
21
  - Bleu: 0.0
22
+ - Gen Len: 0.0
23
 
24
  ## Model description
25
 
 
44
  - seed: 42
45
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
46
  - lr_scheduler_type: linear
47
+ - num_epochs: 100
48
 
49
  ### Training results
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Bleu | Gen Len |
52
  |:-------------:|:-----:|:----:|:---------------:|:----:|:-------:|
53
+ | No log | 1.0 | 3 | 10.4721 | 0.0 | 19.0 |
54
+ | 11.4017 | 2.0 | 6 | 9.4761 | 0.0 | 19.0 |
55
+ | 8.6118 | 3.0 | 9 | 8.6439 | 0.0 | 19.0 |
56
+ | 7.0732 | 4.0 | 12 | 7.8504 | 0.0 | 19.0 |
57
+ | 7.0732 | 5.0 | 15 | 7.0418 | 0.0 | 19.0 |
58
+ | 9.4499 | 6.0 | 18 | 6.4173 | 0.0 | 19.0 |
59
+ | 6.047 | 7.0 | 21 | 5.8917 | 0.0 | 19.0 |
60
+ | 8.5079 | 8.0 | 24 | 5.4822 | 0.0 | 19.0 |
61
+ | 8.5079 | 9.0 | 27 | 5.1167 | 0.0 | 19.0 |
62
+ | 5.3118 | 10.0 | 30 | 4.7820 | 0.0 | 19.0 |
63
+ | 5.1047 | 11.0 | 33 | 4.4711 | 0.0 | 19.0 |
64
+ | 4.2976 | 12.0 | 36 | 4.2040 | 0.0 | 19.0 |
65
+ | 4.2976 | 13.0 | 39 | 3.9466 | 0.0 | 19.0 |
66
+ | 4.3815 | 14.0 | 42 | 3.6867 | 0.0 | 19.0 |
67
+ | 4.1765 | 15.0 | 45 | 3.3908 | 0.0 | 19.0 |
68
+ | 3.6726 | 16.0 | 48 | 3.1037 | 0.0 | 19.0 |
69
+ | 3.6726 | 17.0 | 51 | 2.8341 | 0.0 | 19.0 |
70
+ | 3.5088 | 18.0 | 54 | 2.5814 | 0.0 | 19.0 |
71
+ | 3.4025 | 19.0 | 57 | 2.3402 | 0.0 | 19.0 |
72
+ | 3.4804 | 20.0 | 60 | 2.1320 | 0.0 | 19.0 |
73
+ | 3.4804 | 21.0 | 63 | 1.9531 | 0.0 | 19.0 |
74
+ | 2.9683 | 22.0 | 66 | 1.8089 | 0.0 | 14.7778 |
75
+ | 2.7596 | 23.0 | 69 | 1.7039 | 0.0 | 0.0 |
76
+ | 2.9402 | 24.0 | 72 | 1.6415 | 0.0 | 0.0 |
77
+ | 2.9402 | 25.0 | 75 | 1.6086 | 0.0 | 0.0 |
78
+ | 3.0547 | 26.0 | 78 | 1.5912 | 0.0 | 0.0 |
79
+ | 2.3308 | 27.0 | 81 | 1.5822 | 0.0 | 0.0 |
80
+ | 2.3394 | 28.0 | 84 | 1.5777 | 0.0 | 0.0 |
81
+ | 2.3394 | 29.0 | 87 | 1.5747 | 0.0 | 0.0 |
82
+ | 2.6954 | 30.0 | 90 | 1.5695 | 0.0 | 0.0 |
83
+ | 2.2629 | 31.0 | 93 | 1.5636 | 0.0 | 0.0 |
84
+ | 2.4494 | 32.0 | 96 | 1.5568 | 0.0 | 0.0 |
85
+ | 2.4494 | 33.0 | 99 | 1.5503 | 0.0 | 0.0 |
86
+ | 2.2914 | 34.0 | 102 | 1.5422 | 0.0 | 0.0 |
87
+ | 2.1202 | 35.0 | 105 | 1.5332 | 0.0 | 0.0 |
88
+ | 2.2631 | 36.0 | 108 | 1.5228 | 0.0 | 0.0 |
89
+ | 2.2631 | 37.0 | 111 | 1.5123 | 0.0 | 0.0 |
90
+ | 2.0139 | 38.0 | 114 | 1.5024 | 0.0 | 0.0 |
91
+ | 2.2812 | 39.0 | 117 | 1.4926 | 0.0 | 0.0 |
92
+ | 1.798 | 40.0 | 120 | 1.4836 | 0.0 | 0.0 |
93
+ | 1.798 | 41.0 | 123 | 1.4740 | 0.0 | 0.0 |
94
+ | 1.8001 | 42.0 | 126 | 1.4656 | 0.0 | 0.0 |
95
+ | 2.2109 | 43.0 | 129 | 1.4577 | 0.0 | 0.0 |
96
+ | 1.6209 | 44.0 | 132 | 1.4502 | 0.0 | 0.0 |
97
+ | 1.6209 | 45.0 | 135 | 1.4439 | 0.0 | 0.0 |
98
+ | 2.106 | 46.0 | 138 | 1.4373 | 0.0 | 0.0 |
99
+ | 2.0342 | 47.0 | 141 | 1.4307 | 0.0 | 0.0 |
100
+ | 1.9099 | 48.0 | 144 | 1.4238 | 0.0 | 0.0 |
101
+ | 1.9099 | 49.0 | 147 | 1.4172 | 0.0 | 0.0 |
102
+ | 2.0013 | 50.0 | 150 | 1.4105 | 0.0 | 0.0 |
103
+ | 1.5806 | 51.0 | 153 | 1.4036 | 0.0 | 0.0 |
104
+ | 1.9924 | 52.0 | 156 | 1.3963 | 0.0 | 0.0 |
105
+ | 1.9924 | 53.0 | 159 | 1.3907 | 0.0 | 0.0 |
106
+ | 2.1897 | 54.0 | 162 | 1.3848 | 0.0 | 0.0 |
107
+ | 1.6961 | 55.0 | 165 | 1.3792 | 0.0 | 0.0 |
108
+ | 1.7686 | 56.0 | 168 | 1.3740 | 0.0 | 0.0 |
109
+ | 1.7686 | 57.0 | 171 | 1.3693 | 0.0 | 0.0 |
110
+ | 2.0588 | 58.0 | 174 | 1.3643 | 0.0 | 0.0 |
111
+ | 1.9657 | 59.0 | 177 | 1.3596 | 0.0 | 0.0 |
112
+ | 1.705 | 60.0 | 180 | 1.3556 | 0.0 | 0.0 |
113
+ | 1.705 | 61.0 | 183 | 1.3520 | 0.0 | 0.0 |
114
+ | 1.7669 | 62.0 | 186 | 1.3486 | 0.0 | 0.0 |
115
+ | 1.9735 | 63.0 | 189 | 1.3448 | 0.0 | 0.0 |
116
+ | 2.1708 | 64.0 | 192 | 1.3403 | 0.0 | 0.0 |
117
+ | 2.1708 | 65.0 | 195 | 1.3365 | 0.0 | 0.0 |
118
+ | 1.974 | 66.0 | 198 | 1.3338 | 0.0 | 0.0 |
119
+ | 1.8153 | 67.0 | 201 | 1.3313 | 0.0 | 0.0 |
120
+ | 2.4112 | 68.0 | 204 | 1.3289 | 0.0 | 0.0 |
121
+ | 2.4112 | 69.0 | 207 | 1.3271 | 0.0 | 0.0 |
122
+ | 1.4735 | 70.0 | 210 | 1.3244 | 0.0 | 0.0 |
123
+ | 1.4407 | 71.0 | 213 | 1.3222 | 0.0 | 0.0 |
124
+ | 2.1837 | 72.0 | 216 | 1.3200 | 0.0 | 0.0 |
125
+ | 2.1837 | 73.0 | 219 | 1.3179 | 0.0 | 0.0 |
126
+ | 1.8413 | 74.0 | 222 | 1.3161 | 0.0 | 0.0 |
127
+ | 1.8677 | 75.0 | 225 | 1.3141 | 0.0 | 0.0 |
128
+ | 1.9011 | 76.0 | 228 | 1.3119 | 0.0 | 0.0 |
129
+ | 1.9011 | 77.0 | 231 | 1.3101 | 0.0 | 0.0 |
130
+ | 1.5412 | 78.0 | 234 | 1.3082 | 0.0 | 0.0 |
131
+ | 1.844 | 79.0 | 237 | 1.3064 | 0.0 | 0.0 |
132
+ | 1.8727 | 80.0 | 240 | 1.3044 | 0.0 | 0.0 |
133
+ | 1.8727 | 81.0 | 243 | 1.3026 | 0.0 | 0.0 |
134
+ | 1.8597 | 82.0 | 246 | 1.3007 | 0.0 | 0.0 |
135
+ | 1.889 | 83.0 | 249 | 1.2988 | 0.0 | 0.0 |
136
+ | 1.5874 | 84.0 | 252 | 1.2974 | 0.0 | 0.0 |
137
+ | 1.5874 | 85.0 | 255 | 1.2960 | 0.0 | 0.0 |
138
+ | 1.7652 | 86.0 | 258 | 1.2945 | 0.0 | 0.0 |
139
+ | 1.471 | 87.0 | 261 | 1.2933 | 0.0 | 0.0 |
140
+ | 1.8824 | 88.0 | 264 | 1.2924 | 0.0 | 0.0 |
141
+ | 1.8824 | 89.0 | 267 | 1.2913 | 0.0 | 0.0 |
142
+ | 1.8729 | 90.0 | 270 | 1.2902 | 0.0 | 0.0 |
143
+ | 1.409 | 91.0 | 273 | 1.2894 | 0.0 | 0.0 |
144
+ | 1.5123 | 92.0 | 276 | 1.2889 | 0.0 | 0.0 |
145
+ | 1.5123 | 93.0 | 279 | 1.2882 | 0.0 | 0.0 |
146
+ | 1.3037 | 94.0 | 282 | 1.2876 | 0.0 | 0.0 |
147
+ | 1.8444 | 95.0 | 285 | 1.2871 | 0.0 | 0.0 |
148
+ | 1.3042 | 96.0 | 288 | 1.2866 | 0.0 | 0.0 |
149
+ | 1.3042 | 97.0 | 291 | 1.2863 | 0.0 | 0.0 |
150
+ | 1.5027 | 98.0 | 294 | 1.2861 | 0.0 | 0.0 |
151
+ | 2.0811 | 99.0 | 297 | 1.2860 | 0.0 | 0.0 |
152
+ | 1.4372 | 100.0 | 300 | 1.2859 | 0.0 | 0.0 |
153
 
154
 
155
  ### Framework versions
156
 
157
  - Transformers 4.33.0
158
+ - Pytorch 2.0.0
159
  - Datasets 2.1.0
160
  - Tokenizers 0.13.3
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6055e54f61c97d00a2e0f6693adca6920b226f2630cfd2cc0ba00025243c00bd
3
- size 242069785
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d3ef3c3f15aaf3d290a5b919c3b62fb7cfa3cb1706d21c5fa18c8181e3247b20
3
+ size 242071641
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8f65eee5ea348a2db5829a10756f4a053cf6b725443b1620bb04b7d4c30ecc77
3
  size 4219
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ed930b73c2bafd012a354870d6e9feff4466340b77d1c271049c902ce8c989e
3
  size 4219