Hugging Face's logo

jpodivin
/
rh_qa_model

Question Answering
Transformers
TensorBoard
Safetensors
distilbert
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
1
jpodivin commited on
Commit
9c0713f
·
verified ·
1 Parent(s): 987f435

End of training

Browse files
Files changed (5) hide show
  1. README.md +102 -5
  2. model.safetensors +1 -1
  3. runs/Jan24_14-58-06_2348aa0e5e1b/events.out.tfevents.1706108287.2348aa0e5e1b.18236.0 +3 -0
  4. runs/Jan24_14-58-43_2348aa0e5e1b/events.out.tfevents.1706108323.2348aa0e5e1b.18236.1 +3 -0
  5. training_args.bin +1 -1
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 1.7093
19
 
20
  ## Model description
21
 
@@ -40,15 +40,112 @@ The following hyperparameters were used during training:
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
- - num_epochs: 3
44
 
45
  ### Training results
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
- | No log | 1.0 | 250 | 2.3834 |
50
- | 2.6949 | 2.0 | 500 | 1.7727 |
51
- | 2.6949 | 3.0 | 750 | 1.7093 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
52
 
53
 
54
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 0.0009
19
 
20
  ## Model description
21
 
 
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
+ - num_epochs: 100
44
 
45
  ### Training results
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
+ | No log | 1.0 | 3 | 4.0114 |
50
+ | No log | 2.0 | 6 | 3.1393 |
51
+ | No log | 3.0 | 9 | 2.2885 |
52
+ | No log | 4.0 | 12 | 1.6039 |
53
+ | No log | 5.0 | 15 | 1.1452 |
54
+ | No log | 6.0 | 18 | 0.8409 |
55
+ | No log | 7.0 | 21 | 0.6588 |
56
+ | No log | 8.0 | 24 | 0.5136 |
57
+ | No log | 9.0 | 27 | 0.4312 |
58
+ | No log | 10.0 | 30 | 0.3717 |
59
+ | No log | 11.0 | 33 | 0.3226 |
60
+ | No log | 12.0 | 36 | 0.2853 |
61
+ | No log | 13.0 | 39 | 0.2620 |
62
+ | No log | 14.0 | 42 | 0.2338 |
63
+ | No log | 15.0 | 45 | 0.1985 |
64
+ | No log | 16.0 | 48 | 0.1481 |
65
+ | No log | 17.0 | 51 | 0.0294 |
66
+ | No log | 18.0 | 54 | 0.0184 |
67
+ | No log | 19.0 | 57 | 0.0778 |
68
+ | No log | 20.0 | 60 | 0.0157 |
69
+ | No log | 21.0 | 63 | 0.0101 |
70
+ | No log | 22.0 | 66 | 0.0104 |
71
+ | No log | 23.0 | 69 | 0.0136 |
72
+ | No log | 24.0 | 72 | 0.0094 |
73
+ | No log | 25.0 | 75 | 0.0081 |
74
+ | No log | 26.0 | 78 | 0.0066 |
75
+ | No log | 27.0 | 81 | 0.0057 |
76
+ | No log | 28.0 | 84 | 0.0053 |
77
+ | No log | 29.0 | 87 | 0.0048 |
78
+ | No log | 30.0 | 90 | 0.0043 |
79
+ | No log | 31.0 | 93 | 0.0039 |
80
+ | No log | 32.0 | 96 | 0.0036 |
81
+ | No log | 33.0 | 99 | 0.0038 |
82
+ | No log | 34.0 | 102 | 0.0036 |
83
+ | No log | 35.0 | 105 | 0.0031 |
84
+ | No log | 36.0 | 108 | 0.0029 |
85
+ | No log | 37.0 | 111 | 0.0028 |
86
+ | No log | 38.0 | 114 | 0.0026 |
87
+ | No log | 39.0 | 117 | 0.0025 |
88
+ | No log | 40.0 | 120 | 0.0024 |
89
+ | No log | 41.0 | 123 | 0.0023 |
90
+ | No log | 42.0 | 126 | 0.0022 |
91
+ | No log | 43.0 | 129 | 0.0022 |
92
+ | No log | 44.0 | 132 | 0.0021 |
93
+ | No log | 45.0 | 135 | 0.0020 |
94
+ | No log | 46.0 | 138 | 0.0019 |
95
+ | No log | 47.0 | 141 | 0.0018 |
96
+ | No log | 48.0 | 144 | 0.0017 |
97
+ | No log | 49.0 | 147 | 0.0016 |
98
+ | No log | 50.0 | 150 | 0.0016 |
99
+ | No log | 51.0 | 153 | 0.0015 |
100
+ | No log | 52.0 | 156 | 0.0015 |
101
+ | No log | 53.0 | 159 | 0.0015 |
102
+ | No log | 54.0 | 162 | 0.0014 |
103
+ | No log | 55.0 | 165 | 0.0014 |
104
+ | No log | 56.0 | 168 | 0.0013 |
105
+ | No log | 57.0 | 171 | 0.0013 |
106
+ | No log | 58.0 | 174 | 0.0013 |
107
+ | No log | 59.0 | 177 | 0.0012 |
108
+ | No log | 60.0 | 180 | 0.0012 |
109
+ | No log | 61.0 | 183 | 0.0012 |
110
+ | No log | 62.0 | 186 | 0.0012 |
111
+ | No log | 63.0 | 189 | 0.0011 |
112
+ | No log | 64.0 | 192 | 0.0011 |
113
+ | No log | 65.0 | 195 | 0.0011 |
114
+ | No log | 66.0 | 198 | 0.0011 |
115
+ | No log | 67.0 | 201 | 0.0011 |
116
+ | No log | 68.0 | 204 | 0.0010 |
117
+ | No log | 69.0 | 207 | 0.0010 |
118
+ | No log | 70.0 | 210 | 0.0010 |
119
+ | No log | 71.0 | 213 | 0.0010 |
120
+ | No log | 72.0 | 216 | 0.0010 |
121
+ | No log | 73.0 | 219 | 0.0010 |
122
+ | No log | 74.0 | 222 | 0.0010 |
123
+ | No log | 75.0 | 225 | 0.0010 |
124
+ | No log | 76.0 | 228 | 0.0010 |
125
+ | No log | 77.0 | 231 | 0.0009 |
126
+ | No log | 78.0 | 234 | 0.0009 |
127
+ | No log | 79.0 | 237 | 0.0009 |
128
+ | No log | 80.0 | 240 | 0.0009 |
129
+ | No log | 81.0 | 243 | 0.0009 |
130
+ | No log | 82.0 | 246 | 0.0009 |
131
+ | No log | 83.0 | 249 | 0.0009 |
132
+ | No log | 84.0 | 252 | 0.0009 |
133
+ | No log | 85.0 | 255 | 0.0009 |
134
+ | No log | 86.0 | 258 | 0.0009 |
135
+ | No log | 87.0 | 261 | 0.0009 |
136
+ | No log | 88.0 | 264 | 0.0009 |
137
+ | No log | 89.0 | 267 | 0.0009 |
138
+ | No log | 90.0 | 270 | 0.0009 |
139
+ | No log | 91.0 | 273 | 0.0009 |
140
+ | No log | 92.0 | 276 | 0.0009 |
141
+ | No log | 93.0 | 279 | 0.0009 |
142
+ | No log | 94.0 | 282 | 0.0009 |
143
+ | No log | 95.0 | 285 | 0.0009 |
144
+ | No log | 96.0 | 288 | 0.0009 |
145
+ | No log | 97.0 | 291 | 0.0009 |
146
+ | No log | 98.0 | 294 | 0.0009 |
147
+ | No log | 99.0 | 297 | 0.0009 |
148
+ | No log | 100.0 | 300 | 0.0009 |
149
 
150
 
151
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bb2fcfbd13392d40319ead463322a7e53a887590e1f803be21e58b82342d2abd
3
  size 265470032
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ffa99bd53665db6cc84358ce8bc8c643443c296b8bd763034e093f23178c8cbf
3
  size 265470032
runs/Jan24_14-58-06_2348aa0e5e1b/events.out.tfevents.1706108287.2348aa0e5e1b.18236.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:748c436837d12fe1a4a55048a483f5d66610d440305ca45437fc2d1a912907dd
3
+ size 5222
runs/Jan24_14-58-43_2348aa0e5e1b/events.out.tfevents.1706108323.2348aa0e5e1b.18236.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a9d724919ae6e7dc171867eb5bce2b5cb2f31a1879c64e06b53f1693a989a134
3
+ size 31322
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8723e101b6a80b445601103231068ed70b800cfc2e68faf274e9457bafdcf072
3
  size 4536
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:01e4b81f8ec7d994c7a6b68ea9baaca92dd4e856afc6dbd997a2cc3d51f9fae6
3
  size 4536