Hugging Face's logo

veronica-girolimetti
/
t5-dialogue-classification-enriched

Text2Text Generation
Transformers
TensorBoard
Safetensors
t5
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Metrics Community
veronica-girolimetti commited on
Commit
51ee101
•
1 Parent(s): 53391fe

End of training

Browse files
Files changed (3) hide show
  1. README.md +283 -283
  2. model.safetensors +1 -1
  3. runs/Jan15_15-34-56_5d03746b44d6/events.out.tfevents.1705333995.5d03746b44d6.3518.1 +2 -2
README.md CHANGED
@@ -15,33 +15,33 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [google/flan-t5-small](https://huggingface.co/google/flan-t5-small) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 0.3777
19
  - Classification Report: precision recall f1-score support
20
 
21
- ALLERGY 0.9167 0.9167 0.9167 12
22
- ASSESSMENT 0.5714 0.3636 0.4444 11
23
- CC 0.5000 0.3636 0.4211 11
24
  DIAGNOSIS 0.0000 0.0000 0.0000 1
25
  DISPOSITION 0.0000 0.0000 0.0000 1
26
  EDCOURSE 0.0000 0.0000 0.0000 4
27
- EXAM 0.3333 0.2000 0.2500 5
28
  FAM/SOCHX 0.8600 0.9556 0.9053 45
29
  GENHX 0.8246 0.8868 0.8545 53
30
  GYNHX 0.0000 0.0000 0.0000 1
31
- IMAGING 0.0000 0.0000 0.0000 1
32
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
33
  LABS 0.0000 0.0000 0.0000 1
34
  MEDICATIONS 0.7692 1.0000 0.8696 10
35
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
36
- PASTMEDICALHX 0.5652 0.9286 0.7027 14
37
- PASTSURGICAL 1.0000 0.8571 0.9231 7
38
- PLAN 0.0000 0.0000 0.0000 1
39
  PROCEDURES 0.0000 0.0000 0.0000 1
40
  ROS 0.8000 0.7059 0.7500 17
41
 
42
- accuracy 0.7550 200
43
- macro avg 0.3570 0.3589 0.3519 200
44
- weighted avg 0.7153 0.7550 0.7277 200
45
 
46
 
47
  ## Model description
@@ -73,545 +73,545 @@ The following hyperparameters were used during training:
73
 
74
  | Training Loss | Epoch | Step | Validation Loss | Classification Report |
75
  |:-------------:|:-----:|:----:|:---------------:|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
76
- | No log | 1.0 | 172 | 0.3252 | precision recall f1-score support
77
 
78
  ALLERGY 1.0000 0.9167 0.9565 12
79
- ASSESSMENT 0.0000 0.0000 0.0000 11
80
- CC 0.2727 0.2727 0.2727 11
81
  DIAGNOSIS 0.0000 0.0000 0.0000 1
82
  DISPOSITION 0.0000 0.0000 0.0000 1
83
- EDCOURSE 0.0000 0.0000 0.0000 4
84
- EXAM 0.0000 0.0000 0.0000 5
85
  FAM/SOCHX 0.8571 0.9333 0.8936 45
86
- GENHX 0.6923 0.8491 0.7627 53
87
- GYNHX 0.0000 0.0000 0.0000 1
88
- IMAGING 0.0000 0.0000 0.0000 1
89
- IMMUNIZATIONS 0.0000 0.0000 0.0000 1
90
- LABS 0.0000 0.0000 0.0000 1
91
- MEDICATIONS 0.8182 0.9000 0.8571 10
92
- OTHER_HISTORY 0.0000 0.0000 0.0000 3
93
- PASTMEDICALHX 0.3158 0.8571 0.4615 14
94
- PASTSURGICAL 0.8750 1.0000 0.9333 7
95
- PLAN 0.0000 0.0000 0.0000 1
96
- PROCEDURES 0.0000 0.0000 0.0000 1
97
- ROS 0.4000 0.1176 0.1818 17
98
-
99
- accuracy 0.6550 200
100
- macro avg 0.2616 0.2923 0.2660 200
101
- weighted avg 0.5790 0.6550 0.5989 200
102
- |
103
- | No log | 2.0 | 344 | 0.2772 | precision recall f1-score support
104
-
105
- ALLERGY 1.0000 0.9167 0.9565 12
106
- ASSESSMENT 0.0000 0.0000 0.0000 11
107
- CC 0.4000 0.5455 0.4615 11
108
- DIAGNOSIS 0.0000 0.0000 0.0000 1
109
- DISPOSITION 0.0000 0.0000 0.0000 1
110
- EDCOURSE 0.0000 0.0000 0.0000 4
111
- EXAM 0.0000 0.0000 0.0000 5
112
- FAM/SOCHX 0.8269 0.9556 0.8866 45
113
- GENHX 0.7541 0.8679 0.8070 53
114
  GYNHX 0.0000 0.0000 0.0000 1
115
  IMAGING 0.0000 0.0000 0.0000 1
116
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
117
  LABS 0.0000 0.0000 0.0000 1
118
- MEDICATIONS 0.8333 1.0000 0.9091 10
119
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
120
- PASTMEDICALHX 0.4615 0.8571 0.6000 14
121
  PASTSURGICAL 1.0000 1.0000 1.0000 7
122
  PLAN 0.0000 0.0000 0.0000 1
123
  PROCEDURES 0.0000 0.0000 0.0000 1
124
- ROS 0.6923 0.5294 0.6000 17
125
 
126
- accuracy 0.7200 200
127
- macro avg 0.2984 0.3336 0.3110 200
128
- weighted avg 0.6357 0.7200 0.6696 200
129
  |
130
- | 0.2496 | 3.0 | 516 | 0.2897 | precision recall f1-score support
131
 
132
  ALLERGY 1.0000 0.9167 0.9565 12
133
- ASSESSMENT 0.0000 0.0000 0.0000 11
134
- CC 0.3333 0.3636 0.3478 11
135
  DIAGNOSIS 0.0000 0.0000 0.0000 1
136
  DISPOSITION 0.0000 0.0000 0.0000 1
137
  EDCOURSE 0.0000 0.0000 0.0000 4
138
- EXAM 0.5000 0.2000 0.2857 5
139
- FAM/SOCHX 0.8627 0.9778 0.9167 45
140
- GENHX 0.6216 0.8679 0.7244 53
141
  GYNHX 0.0000 0.0000 0.0000 1
142
  IMAGING 0.0000 0.0000 0.0000 1
143
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
144
  LABS 0.0000 0.0000 0.0000 1
145
- MEDICATIONS 0.8333 1.0000 0.9091 10
146
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
147
- PASTMEDICALHX 0.6250 0.7143 0.6667 14
148
  PASTSURGICAL 0.7000 1.0000 0.8235 7
149
  PLAN 0.0000 0.0000 0.0000 1
150
  PROCEDURES 0.0000 0.0000 0.0000 1
151
- ROS 0.7500 0.5294 0.6207 17
152
 
153
- accuracy 0.7100 200
154
- macro avg 0.3113 0.3285 0.3126 200
155
- weighted avg 0.6233 0.7100 0.6556 200
156
  |
157
- | 0.2496 | 4.0 | 688 | 0.2703 | precision recall f1-score support
158
 
159
- ALLERGY 0.9167 0.9167 0.9167 12
160
- ASSESSMENT 0.0000 0.0000 0.0000 11
161
- CC 0.5556 0.4545 0.5000 11
162
  DIAGNOSIS 0.0000 0.0000 0.0000 1
163
  DISPOSITION 0.0000 0.0000 0.0000 1
164
  EDCOURSE 0.0000 0.0000 0.0000 4
165
- EXAM 0.5000 0.4000 0.4444 5
166
- FAM/SOCHX 0.8600 0.9556 0.9053 45
167
- GENHX 0.7344 0.8868 0.8034 53
168
  GYNHX 0.0000 0.0000 0.0000 1
169
- IMAGING 0.0000 0.0000 0.0000 1
170
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
171
  LABS 0.0000 0.0000 0.0000 1
172
- MEDICATIONS 0.8333 1.0000 0.9091 10
173
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
174
- PASTMEDICALHX 0.5000 0.8571 0.6316 14
175
- PASTSURGICAL 1.0000 0.8571 0.9231 7
176
- PLAN 0.0000 0.0000 0.0000 1
177
  PROCEDURES 0.0000 0.0000 0.0000 1
178
- ROS 0.7647 0.7647 0.7647 17
179
 
180
- accuracy 0.7450 200
181
- macro avg 0.3332 0.3546 0.3399 200
182
- weighted avg 0.6628 0.7450 0.6972 200
183
  |
184
- | 0.2496 | 5.0 | 860 | 0.2670 | precision recall f1-score support
185
 
186
- ALLERGY 0.9167 0.9167 0.9167 12
187
- ASSESSMENT 0.0000 0.0000 0.0000 11
188
- CC 0.4545 0.4545 0.4545 11
189
  DIAGNOSIS 0.0000 0.0000 0.0000 1
190
- DISPOSITION 0.0000 0.0000 0.0000 1
191
  EDCOURSE 1.0000 0.2500 0.4000 4
192
- EXAM 0.5000 0.4000 0.4444 5
193
  FAM/SOCHX 0.8600 0.9556 0.9053 45
194
- GENHX 0.8036 0.8491 0.8257 53
195
  GYNHX 0.0000 0.0000 0.0000 1
196
- IMAGING 0.0000 0.0000 0.0000 1
197
- IMMUNIZATIONS 0.0000 0.0000 0.0000 1
198
  LABS 0.0000 0.0000 0.0000 1
199
  MEDICATIONS 0.7692 1.0000 0.8696 10
200
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
201
- PASTMEDICALHX 0.5263 0.7143 0.6061 14
202
- PASTSURGICAL 0.5385 1.0000 0.7000 7
203
  PLAN 0.0000 0.0000 0.0000 1
204
  PROCEDURES 0.0000 0.0000 0.0000 1
205
- ROS 0.7647 0.7647 0.7647 17
206
 
207
- accuracy 0.7350 200
208
- macro avg 0.3567 0.3652 0.3443 200
209
- weighted avg 0.6781 0.7350 0.6970 200
210
  |
211
- | 0.1353 | 6.0 | 1032 | 0.2786 | precision recall f1-score support
212
 
213
  ALLERGY 1.0000 0.9167 0.9565 12
214
- ASSESSMENT 0.0000 0.0000 0.0000 11
215
  CC 0.6250 0.4545 0.5263 11
216
  DIAGNOSIS 0.0000 0.0000 0.0000 1
217
  DISPOSITION 0.0000 0.0000 0.0000 1
218
- EDCOURSE 1.0000 0.5000 0.6667 4
219
- EXAM 0.2500 0.2000 0.2222 5
220
  FAM/SOCHX 0.8776 0.9556 0.9149 45
221
- GENHX 0.7966 0.8868 0.8393 53
222
  GYNHX 0.0000 0.0000 0.0000 1
223
  IMAGING 0.0000 0.0000 0.0000 1
224
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
225
  LABS 0.0000 0.0000 0.0000 1
226
- MEDICATIONS 0.7692 1.0000 0.8696 10
227
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
228
- PASTMEDICALHX 0.4583 0.7857 0.5789 14
229
- PASTSURGICAL 0.6364 1.0000 0.7778 7
230
  PLAN 0.0000 0.0000 0.0000 1
231
  PROCEDURES 0.0000 0.0000 0.0000 1
232
- ROS 0.7647 0.7647 0.7647 17
233
 
234
  accuracy 0.7500 200
235
- macro avg 0.3589 0.3732 0.3558 200
236
- weighted avg 0.6870 0.7500 0.7097 200
237
  |
238
- | 0.1353 | 7.0 | 1204 | 0.2730 | precision recall f1-score support
239
 
240
- ALLERGY 0.9167 0.9167 0.9167 12
241
- ASSESSMENT 0.5000 0.0909 0.1538 11
242
- CC 0.5000 0.5455 0.5217 11
243
  DIAGNOSIS 0.0000 0.0000 0.0000 1
244
  DISPOSITION 0.0000 0.0000 0.0000 1
245
  EDCOURSE 0.0000 0.0000 0.0000 4
246
- EXAM 0.1667 0.2000 0.1818 5
247
- FAM/SOCHX 0.8600 0.9556 0.9053 45
248
- GENHX 0.7797 0.8679 0.8214 53
249
  GYNHX 0.0000 0.0000 0.0000 1
250
  IMAGING 0.0000 0.0000 0.0000 1
251
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
252
  LABS 0.0000 0.0000 0.0000 1
253
  MEDICATIONS 0.7692 1.0000 0.8696 10
254
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
255
- PASTMEDICALHX 0.5455 0.8571 0.6667 14
256
  PASTSURGICAL 0.8571 0.8571 0.8571 7
257
  PLAN 0.0000 0.0000 0.0000 1
258
  PROCEDURES 0.0000 0.0000 0.0000 1
259
- ROS 0.8000 0.7059 0.7500 17
260
 
261
- accuracy 0.7400 200
262
- macro avg 0.3347 0.3498 0.3322 200
263
- weighted avg 0.6889 0.7400 0.7020 200
264
  |
265
- | 0.1353 | 8.0 | 1376 | 0.3150 | precision recall f1-score support
266
 
267
  ALLERGY 1.0000 0.9167 0.9565 12
268
- ASSESSMENT 0.5000 0.0909 0.1538 11
269
- CC 0.4167 0.4545 0.4348 11
270
  DIAGNOSIS 0.0000 0.0000 0.0000 1
271
  DISPOSITION 0.0000 0.0000 0.0000 1
272
  EDCOURSE 0.0000 0.0000 0.0000 4
273
- EXAM 0.1667 0.2000 0.1818 5
274
- FAM/SOCHX 0.8627 0.9778 0.9167 45
275
- GENHX 0.8036 0.8491 0.8257 53
276
  GYNHX 0.0000 0.0000 0.0000 1
277
  IMAGING 0.0000 0.0000 0.0000 1
278
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
279
  LABS 0.0000 0.0000 0.0000 1
280
- MEDICATIONS 0.7692 1.0000 0.8696 10
281
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
282
- PASTMEDICALHX 0.5000 0.9286 0.6500 14
283
  PASTSURGICAL 1.0000 0.8571 0.9231 7
284
- PLAN 0.0000 0.0000 0.0000 1
285
  PROCEDURES 0.0000 0.0000 0.0000 1
286
- ROS 0.7857 0.6471 0.7097 17
287
 
288
  accuracy 0.7350 200
289
- macro avg 0.3402 0.3461 0.3311 200
290
- weighted avg 0.6969 0.7350 0.7010 200
291
  |
292
- | 0.0858 | 9.0 | 1548 | 0.3058 | precision recall f1-score support
293
 
294
  ALLERGY 1.0000 0.9167 0.9565 12
295
- ASSESSMENT 0.6667 0.1818 0.2857 11
296
- CC 0.7500 0.2727 0.4000 11
297
  DIAGNOSIS 0.0000 0.0000 0.0000 1
298
- DISPOSITION 0.3333 1.0000 0.5000 1
299
- EDCOURSE 1.0000 0.2500 0.4000 4
300
- EXAM 0.2500 0.2000 0.2222 5
301
- FAM/SOCHX 0.8627 0.9778 0.9167 45
302
- GENHX 0.7541 0.8679 0.8070 53
303
  GYNHX 0.0000 0.0000 0.0000 1
304
  IMAGING 0.0000 0.0000 0.0000 1
305
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
306
  LABS 0.0000 0.0000 0.0000 1
307
  MEDICATIONS 0.7692 1.0000 0.8696 10
308
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
309
- PASTMEDICALHX 0.5200 0.9286 0.6667 14
310
- PASTSURGICAL 1.0000 0.8571 0.9231 7
311
- PLAN 0.0000 0.0000 0.0000 1
312
  PROCEDURES 0.0000 0.0000 0.0000 1
313
- ROS 0.8000 0.7059 0.7500 17
314
 
315
  accuracy 0.7500 200
316
- macro avg 0.4353 0.4079 0.3849 200
317
- weighted avg 0.7376 0.7500 0.7175 200
318
  |
319
- | 0.0858 | 10.0 | 1720 | 0.2911 | precision recall f1-score support
320
 
321
  ALLERGY 1.0000 0.9167 0.9565 12
322
- ASSESSMENT 0.4286 0.2727 0.3333 11
323
- CC 0.4444 0.3636 0.4000 11
324
  DIAGNOSIS 0.0000 0.0000 0.0000 1
325
  DISPOSITION 0.0000 0.0000 0.0000 1
326
  EDCOURSE 0.5000 0.2500 0.3333 4
327
  EXAM 0.5000 0.2000 0.2857 5
328
- FAM/SOCHX 0.8627 0.9778 0.9167 45
329
- GENHX 0.7759 0.8491 0.8108 53
330
  GYNHX 0.0000 0.0000 0.0000 1
331
  IMAGING 0.0000 0.0000 0.0000 1
332
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
333
  LABS 0.0000 0.0000 0.0000 1
334
  MEDICATIONS 0.7692 1.0000 0.8696 10
335
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
336
- PASTMEDICALHX 0.5455 0.8571 0.6667 14
337
- PASTSURGICAL 1.0000 0.8571 0.9231 7
338
- PLAN 0.0000 0.0000 0.0000 1
339
  PROCEDURES 0.0000 0.0000 0.0000 1
340
- ROS 0.8000 0.7059 0.7500 17
341
 
342
- accuracy 0.7450 200
343
- macro avg 0.3813 0.3625 0.3623 200
344
- weighted avg 0.7099 0.7450 0.7189 200
345
  |
346
- | 0.0858 | 11.0 | 1892 | 0.3449 | precision recall f1-score support
347
 
348
  ALLERGY 1.0000 0.9167 0.9565 12
349
- ASSESSMENT 0.5000 0.2727 0.3529 11
350
- CC 0.8000 0.3636 0.5000 11
351
  DIAGNOSIS 0.0000 0.0000 0.0000 1
352
- DISPOSITION 0.3333 1.0000 0.5000 1
353
  EDCOURSE 0.0000 0.0000 0.0000 4
354
- EXAM 0.2500 0.2000 0.2222 5
355
- FAM/SOCHX 0.8627 0.9778 0.9167 45
356
- GENHX 0.7833 0.8868 0.8319 53
357
  GYNHX 0.0000 0.0000 0.0000 1
358
- IMAGING 0.0000 0.0000 0.0000 1
359
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
360
  LABS 0.0000 0.0000 0.0000 1
361
  MEDICATIONS 0.7692 1.0000 0.8696 10
362
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
363
- PASTMEDICALHX 0.5000 0.8571 0.6316 14
364
- PASTSURGICAL 1.0000 0.8571 0.9231 7
365
- PLAN 0.0000 0.0000 0.0000 1
366
  PROCEDURES 0.0000 0.0000 0.0000 1
367
- ROS 0.7857 0.6471 0.7097 17
368
 
369
  accuracy 0.7500 200
370
- macro avg 0.3792 0.3989 0.3707 200
371
- weighted avg 0.7164 0.7500 0.7194 200
372
  |
373
- | 0.0533 | 12.0 | 2064 | 0.3194 | precision recall f1-score support
374
 
375
  ALLERGY 1.0000 0.9167 0.9565 12
376
- ASSESSMENT 0.5714 0.3636 0.4444 11
377
- CC 0.7143 0.4545 0.5556 11
378
  DIAGNOSIS 0.0000 0.0000 0.0000 1
379
  DISPOSITION 0.0000 0.0000 0.0000 1
380
  EDCOURSE 0.0000 0.0000 0.0000 4
381
- EXAM 0.3333 0.2000 0.2500 5
382
- FAM/SOCHX 0.8627 0.9778 0.9167 45
383
- GENHX 0.8070 0.8679 0.8364 53
384
  GYNHX 0.0000 0.0000 0.0000 1
385
  IMAGING 0.0000 0.0000 0.0000 1
386
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
387
  LABS 0.0000 0.0000 0.0000 1
388
  MEDICATIONS 0.7692 1.0000 0.8696 10
389
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
390
- PASTMEDICALHX 0.5217 0.8571 0.6486 14
391
- PASTSURGICAL 1.0000 0.8571 0.9231 7
392
- PLAN 0.0000 0.0000 0.0000 1
393
  PROCEDURES 0.0000 0.0000 0.0000 1
394
- ROS 0.8125 0.7647 0.7879 17
395
 
396
- accuracy 0.7600 200
397
- macro avg 0.3696 0.3630 0.3594 200
398
- weighted avg 0.7261 0.7600 0.7347 200
399
  |
400
- | 0.0533 | 13.0 | 2236 | 0.3398 | precision recall f1-score support
401
 
402
  ALLERGY 1.0000 0.9167 0.9565 12
403
- ASSESSMENT 0.6000 0.2727 0.3750 11
404
- CC 0.5000 0.3636 0.4211 11
405
  DIAGNOSIS 0.0000 0.0000 0.0000 1
406
  DISPOSITION 0.0000 0.0000 0.0000 1
407
- EDCOURSE 0.5000 0.2500 0.3333 4
408
- EXAM 1.0000 0.2000 0.3333 5
409
- FAM/SOCHX 0.8600 0.9556 0.9053 45
410
- GENHX 0.7460 0.8868 0.8103 53
411
  GYNHX 0.0000 0.0000 0.0000 1
412
- IMAGING 0.0000 0.0000 0.0000 1
413
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
414
  LABS 0.0000 0.0000 0.0000 1
415
  MEDICATIONS 0.7692 1.0000 0.8696 10
416
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
417
- PASTMEDICALHX 0.5714 0.8571 0.6857 14
418
- PASTSURGICAL 1.0000 0.8571 0.9231 7
419
- PLAN 0.0000 0.0000 0.0000 1
420
  PROCEDURES 0.0000 0.0000 0.0000 1
421
- ROS 0.8000 0.7059 0.7500 17
422
 
423
- accuracy 0.7500 200
424
- macro avg 0.4173 0.3633 0.3682 200
425
- weighted avg 0.7282 0.7500 0.7221 200
426
  |
427
- | 0.0533 | 14.0 | 2408 | 0.3339 | precision recall f1-score support
428
 
429
  ALLERGY 1.0000 0.9167 0.9565 12
430
  ASSESSMENT 0.5714 0.3636 0.4444 11
431
- CC 0.6250 0.4545 0.5263 11
432
  DIAGNOSIS 0.0000 0.0000 0.0000 1
433
  DISPOSITION 0.0000 0.0000 0.0000 1
434
  EDCOURSE 0.0000 0.0000 0.0000 4
435
- EXAM 0.3333 0.2000 0.2500 5
436
- FAM/SOCHX 0.8627 0.9778 0.9167 45
437
- GENHX 0.8246 0.8868 0.8545 53
438
  GYNHX 0.0000 0.0000 0.0000 1
439
- IMAGING 0.0000 0.0000 0.0000 1
440
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
441
  LABS 0.0000 0.0000 0.0000 1
442
  MEDICATIONS 0.7692 1.0000 0.8696 10
443
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
444
- PASTMEDICALHX 0.6500 0.9286 0.7647 14
445
- PASTSURGICAL 0.7778 1.0000 0.8750 7
446
- PLAN 0.0000 0.0000 0.0000 1
447
  PROCEDURES 0.0000 0.0000 0.0000 1
448
- ROS 0.8000 0.7059 0.7500 17
449
 
450
  accuracy 0.7700 200
451
- macro avg 0.3607 0.3717 0.3604 200
452
- weighted avg 0.7259 0.7700 0.7411 200
453
  |
454
- | 0.0367 | 15.0 | 2580 | 0.3354 | precision recall f1-score support
455
 
456
  ALLERGY 1.0000 0.9167 0.9565 12
457
- ASSESSMENT 0.4000 0.1818 0.2500 11
458
- CC 0.5000 0.5455 0.5217 11
459
  DIAGNOSIS 0.0000 0.0000 0.0000 1
460
  DISPOSITION 0.0000 0.0000 0.0000 1
461
- EDCOURSE 0.5000 0.2500 0.3333 4
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
462
  EXAM 0.5000 0.2000 0.2857 5
463
- FAM/SOCHX 0.8627 0.9778 0.9167 45
464
  GENHX 0.8364 0.8679 0.8519 53
465
  GYNHX 0.0000 0.0000 0.0000 1
466
- IMAGING 0.0000 0.0000 0.0000 1
467
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
468
  LABS 0.0000 0.0000 0.0000 1
469
  MEDICATIONS 0.7692 1.0000 0.8696 10
470
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
471
- PASTMEDICALHX 0.6500 0.9286 0.7647 14
472
- PASTSURGICAL 0.8750 1.0000 0.9333 7
473
- PLAN 0.0000 0.0000 0.0000 1
474
  PROCEDURES 0.0000 0.0000 0.0000 1
475
- ROS 0.7647 0.7647 0.7647 17
476
 
477
- accuracy 0.7700 200
478
- macro avg 0.3829 0.3816 0.3724 200
479
- weighted avg 0.7273 0.7700 0.7403 200
480
  |
481
- | 0.0367 | 16.0 | 2752 | 0.3511 | precision recall f1-score support
482
 
483
  ALLERGY 1.0000 0.9167 0.9565 12
484
- ASSESSMENT 0.5714 0.3636 0.4444 11
485
  CC 0.7143 0.4545 0.5556 11
486
  DIAGNOSIS 0.0000 0.0000 0.0000 1
487
  DISPOSITION 0.0000 0.0000 0.0000 1
488
- EDCOURSE 0.5000 0.2500 0.3333 4
489
  EXAM 0.5000 0.2000 0.2857 5
490
- FAM/SOCHX 0.8627 0.9778 0.9167 45
491
- GENHX 0.8246 0.8868 0.8545 53
492
  GYNHX 0.0000 0.0000 0.0000 1
493
- IMAGING 0.0000 0.0000 0.0000 1
494
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
495
  LABS 0.0000 0.0000 0.0000 1
496
  MEDICATIONS 0.7692 1.0000 0.8696 10
497
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
498
- PASTMEDICALHX 0.5652 0.9286 0.7027 14
499
  PASTSURGICAL 1.0000 0.8571 0.9231 7
500
- PLAN 0.0000 0.0000 0.0000 1
501
  PROCEDURES 0.0000 0.0000 0.0000 1
502
- ROS 0.8125 0.7647 0.7879 17
503
 
504
- accuracy 0.7750 200
505
- macro avg 0.4060 0.3800 0.3815 200
506
- weighted avg 0.7479 0.7750 0.7509 200
507
  |
508
- | 0.0367 | 17.0 | 2924 | 0.3552 | precision recall f1-score support
509
 
510
  ALLERGY 1.0000 0.9167 0.9565 12
511
- ASSESSMENT 0.5714 0.3636 0.4444 11
512
- CC 0.6667 0.3636 0.4706 11
513
  DIAGNOSIS 0.0000 0.0000 0.0000 1
514
  DISPOSITION 0.0000 0.0000 0.0000 1
515
  EDCOURSE 0.0000 0.0000 0.0000 4
516
- EXAM 0.3333 0.2000 0.2500 5
517
  FAM/SOCHX 0.8600 0.9556 0.9053 45
518
- GENHX 0.8246 0.8868 0.8545 53
519
  GYNHX 0.0000 0.0000 0.0000 1
520
- IMAGING 0.0000 0.0000 0.0000 1
521
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
522
  LABS 0.0000 0.0000 0.0000 1
523
  MEDICATIONS 0.7692 1.0000 0.8696 10
524
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
525
- PASTMEDICALHX 0.5652 0.9286 0.7027 14
526
- PASTSURGICAL 0.8750 1.0000 0.9333 7
527
- PLAN 0.0000 0.0000 0.0000 1
528
  PROCEDURES 0.0000 0.0000 0.0000 1
529
  ROS 0.8000 0.7059 0.7500 17
530
 
531
- accuracy 0.7600 200
532
- macro avg 0.3633 0.3660 0.3568 200
533
- weighted avg 0.7251 0.7600 0.7332 200
534
  |
535
- | 0.0258 | 18.0 | 3096 | 0.3670 | precision recall f1-score support
536
 
537
  ALLERGY 1.0000 0.9167 0.9565 12
538
- ASSESSMENT 0.5714 0.3636 0.4444 11
539
- CC 0.5000 0.4545 0.4762 11
540
  DIAGNOSIS 0.0000 0.0000 0.0000 1
541
  DISPOSITION 0.0000 0.0000 0.0000 1
542
  EDCOURSE 0.0000 0.0000 0.0000 4
543
- EXAM 0.3333 0.2000 0.2500 5
544
- FAM/SOCHX 0.8627 0.9778 0.9167 45
545
- GENHX 0.8333 0.8491 0.8411 53
546
  GYNHX 0.0000 0.0000 0.0000 1
547
- IMAGING 0.0000 0.0000 0.0000 1
548
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
549
  LABS 0.0000 0.0000 0.0000 1
550
  MEDICATIONS 0.7692 1.0000 0.8696 10
551
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
552
- PASTMEDICALHX 0.5652 0.9286 0.7027 14
553
- PASTSURGICAL 1.0000 0.8571 0.9231 7
554
- PLAN 0.0000 0.0000 0.0000 1
555
  PROCEDURES 0.0000 0.0000 0.0000 1
556
  ROS 0.8000 0.7059 0.7500 17
557
 
558
- accuracy 0.7550 200
559
- macro avg 0.3618 0.3627 0.3565 200
560
- weighted avg 0.7232 0.7550 0.7321 200
561
  |
562
- | 0.0258 | 19.0 | 3268 | 0.3751 | precision recall f1-score support
563
 
564
- ALLERGY 0.9167 0.9167 0.9167 12
565
- ASSESSMENT 0.5714 0.3636 0.4444 11
566
- CC 0.6667 0.3636 0.4706 11
567
  DIAGNOSIS 0.0000 0.0000 0.0000 1
568
  DISPOSITION 0.0000 0.0000 0.0000 1
569
  EDCOURSE 0.0000 0.0000 0.0000 4
570
- EXAM 0.3333 0.2000 0.2500 5
571
  FAM/SOCHX 0.8600 0.9556 0.9053 45
572
  GENHX 0.8246 0.8868 0.8545 53
573
  GYNHX 0.0000 0.0000 0.0000 1
574
- IMAGING 0.0000 0.0000 0.0000 1
575
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
576
  LABS 0.0000 0.0000 0.0000 1
577
  MEDICATIONS 0.7692 1.0000 0.8696 10
578
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
579
- PASTMEDICALHX 0.5417 0.9286 0.6842 14
580
- PASTSURGICAL 1.0000 0.8571 0.9231 7
581
- PLAN 0.0000 0.0000 0.0000 1
582
  PROCEDURES 0.0000 0.0000 0.0000 1
583
  ROS 0.8000 0.7059 0.7500 17
584
 
585
- accuracy 0.7550 200
586
- macro avg 0.3642 0.3589 0.3534 200
587
- weighted avg 0.7228 0.7550 0.7291 200
588
  |
589
- | 0.0258 | 20.0 | 3440 | 0.3777 | precision recall f1-score support
590
 
591
- ALLERGY 0.9167 0.9167 0.9167 12
592
- ASSESSMENT 0.5714 0.3636 0.4444 11
593
- CC 0.5000 0.3636 0.4211 11
594
  DIAGNOSIS 0.0000 0.0000 0.0000 1
595
  DISPOSITION 0.0000 0.0000 0.0000 1
596
  EDCOURSE 0.0000 0.0000 0.0000 4
597
- EXAM 0.3333 0.2000 0.2500 5
598
  FAM/SOCHX 0.8600 0.9556 0.9053 45
599
  GENHX 0.8246 0.8868 0.8545 53
600
  GYNHX 0.0000 0.0000 0.0000 1
601
- IMAGING 0.0000 0.0000 0.0000 1
602
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
603
  LABS 0.0000 0.0000 0.0000 1
604
  MEDICATIONS 0.7692 1.0000 0.8696 10
605
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
606
- PASTMEDICALHX 0.5652 0.9286 0.7027 14
607
- PASTSURGICAL 1.0000 0.8571 0.9231 7
608
- PLAN 0.0000 0.0000 0.0000 1
609
  PROCEDURES 0.0000 0.0000 0.0000 1
610
  ROS 0.8000 0.7059 0.7500 17
611
 
612
- accuracy 0.7550 200
613
- macro avg 0.3570 0.3589 0.3519 200
614
- weighted avg 0.7153 0.7550 0.7277 200
615
  |
616
 
617
 
 
15
 
16
  This model is a fine-tuned version of [google/flan-t5-small](https://huggingface.co/google/flan-t5-small) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 0.5190
19
  - Classification Report: precision recall f1-score support
20
 
21
+ ALLERGY 1.0000 0.9167 0.9565 12
22
+ ASSESSMENT 0.4444 0.3636 0.4000 11
23
+ CC 0.6250 0.4545 0.5263 11
24
  DIAGNOSIS 0.0000 0.0000 0.0000 1
25
  DISPOSITION 0.0000 0.0000 0.0000 1
26
  EDCOURSE 0.0000 0.0000 0.0000 4
27
+ EXAM 0.5000 0.2000 0.2857 5
28
  FAM/SOCHX 0.8600 0.9556 0.9053 45
29
  GENHX 0.8246 0.8868 0.8545 53
30
  GYNHX 0.0000 0.0000 0.0000 1
31
+ IMAGING 1.0000 1.0000 1.0000 1
32
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
33
  LABS 0.0000 0.0000 0.0000 1
34
  MEDICATIONS 0.7692 1.0000 0.8696 10
35
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
36
+ PASTMEDICALHX 0.6000 0.8571 0.7059 14
37
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
38
+ PLAN 0.3333 1.0000 0.5000 1
39
  PROCEDURES 0.0000 0.0000 0.0000 1
40
  ROS 0.8000 0.7059 0.7500 17
41
 
42
+ accuracy 0.7650 200
43
+ macro avg 0.4307 0.4599 0.4305 200
44
+ weighted avg 0.7285 0.7650 0.7398 200
45
 
46
 
47
  ## Model description
 
73
 
74
  | Training Loss | Epoch | Step | Validation Loss | Classification Report |
75
  |:-------------:|:-----:|:----:|:---------------:|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
76
+ | No log | 1.0 | 172 | 0.3910 | precision recall f1-score support
77
 
78
  ALLERGY 1.0000 0.9167 0.9565 12
79
+ ASSESSMENT 0.4545 0.4545 0.4545 11
80
+ CC 0.5714 0.3636 0.4444 11
81
  DIAGNOSIS 0.0000 0.0000 0.0000 1
82
  DISPOSITION 0.0000 0.0000 0.0000 1
83
+ EDCOURSE 1.0000 0.2500 0.4000 4
84
+ EXAM 0.5000 0.2000 0.2857 5
85
  FAM/SOCHX 0.8571 0.9333 0.8936 45
86
+ GENHX 0.8070 0.8679 0.8364 53
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
87
  GYNHX 0.0000 0.0000 0.0000 1
88
  IMAGING 0.0000 0.0000 0.0000 1
89
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
90
  LABS 0.0000 0.0000 0.0000 1
91
+ MEDICATIONS 0.7500 0.9000 0.8182 10
92
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
93
+ PASTMEDICALHX 0.5714 0.8571 0.6857 14
94
  PASTSURGICAL 1.0000 1.0000 1.0000 7
95
  PLAN 0.0000 0.0000 0.0000 1
96
  PROCEDURES 0.0000 0.0000 0.0000 1
97
+ ROS 0.8125 0.7647 0.7879 17
98
 
99
+ accuracy 0.7550 200
100
+ macro avg 0.4162 0.3754 0.3781 200
101
+ weighted avg 0.7372 0.7550 0.7356 200
102
  |
103
+ | No log | 2.0 | 344 | 0.3943 | precision recall f1-score support
104
 
105
  ALLERGY 1.0000 0.9167 0.9565 12
106
+ ASSESSMENT 0.4286 0.2727 0.3333 11
107
+ CC 0.7143 0.4545 0.5556 11
108
  DIAGNOSIS 0.0000 0.0000 0.0000 1
109
  DISPOSITION 0.0000 0.0000 0.0000 1
110
  EDCOURSE 0.0000 0.0000 0.0000 4
111
+ EXAM 0.3333 0.2000 0.2500 5
112
+ FAM/SOCHX 0.8600 0.9556 0.9053 45
113
+ GENHX 0.7833 0.8868 0.8319 53
114
  GYNHX 0.0000 0.0000 0.0000 1
115
  IMAGING 0.0000 0.0000 0.0000 1
116
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
117
  LABS 0.0000 0.0000 0.0000 1
118
+ MEDICATIONS 0.7692 1.0000 0.8696 10
119
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
120
+ PASTMEDICALHX 0.6111 0.7857 0.6875 14
121
  PASTSURGICAL 0.7000 1.0000 0.8235 7
122
  PLAN 0.0000 0.0000 0.0000 1
123
  PROCEDURES 0.0000 0.0000 0.0000 1
124
+ ROS 0.7333 0.6471 0.6875 17
125
 
126
+ accuracy 0.7450 200
127
+ macro avg 0.3467 0.3560 0.3450 200
128
+ weighted avg 0.7003 0.7450 0.7155 200
129
  |
130
+ | 0.0296 | 3.0 | 516 | 0.3963 | precision recall f1-score support
131
 
132
+ ALLERGY 1.0000 0.9167 0.9565 12
133
+ ASSESSMENT 0.5000 0.3636 0.4211 11
134
+ CC 0.5714 0.3636 0.4444 11
135
  DIAGNOSIS 0.0000 0.0000 0.0000 1
136
  DISPOSITION 0.0000 0.0000 0.0000 1
137
  EDCOURSE 0.0000 0.0000 0.0000 4
138
+ EXAM 0.3333 0.2000 0.2500 5
139
+ FAM/SOCHX 0.8571 0.9333 0.8936 45
140
+ GENHX 0.8364 0.8679 0.8519 53
141
  GYNHX 0.0000 0.0000 0.0000 1
142
+ IMAGING 1.0000 1.0000 1.0000 1
143
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
144
  LABS 0.0000 0.0000 0.0000 1
145
+ MEDICATIONS 0.7500 0.9000 0.8182 10
146
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
147
+ PASTMEDICALHX 0.5000 0.9286 0.6500 14
148
+ PASTSURGICAL 0.8750 1.0000 0.9333 7
149
+ PLAN 0.5000 1.0000 0.6667 1
150
  PROCEDURES 0.0000 0.0000 0.0000 1
151
+ ROS 0.7857 0.6471 0.7097 17
152
 
153
+ accuracy 0.7500 200
154
+ macro avg 0.4254 0.4560 0.4298 200
155
+ weighted avg 0.7192 0.7500 0.7258 200
156
  |
157
+ | 0.0296 | 4.0 | 688 | 0.4452 | precision recall f1-score support
158
 
159
+ ALLERGY 1.0000 0.9167 0.9565 12
160
+ ASSESSMENT 0.3750 0.2727 0.3158 11
161
+ CC 0.8000 0.3636 0.5000 11
162
  DIAGNOSIS 0.0000 0.0000 0.0000 1
163
+ DISPOSITION 0.3333 1.0000 0.5000 1
164
  EDCOURSE 1.0000 0.2500 0.4000 4
165
+ EXAM 1.0000 0.2000 0.3333 5
166
  FAM/SOCHX 0.8600 0.9556 0.9053 45
167
+ GENHX 0.8103 0.8868 0.8468 53
168
  GYNHX 0.0000 0.0000 0.0000 1
169
+ IMAGING 1.0000 1.0000 1.0000 1
170
+ IMMUNIZATIONS 0.5000 1.0000 0.6667 1
171
  LABS 0.0000 0.0000 0.0000 1
172
  MEDICATIONS 0.7692 1.0000 0.8696 10
173
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
174
+ PASTMEDICALHX 0.6190 0.9286 0.7429 14
175
+ PASTSURGICAL 0.8750 1.0000 0.9333 7
176
  PLAN 0.0000 0.0000 0.0000 1
177
  PROCEDURES 0.0000 0.0000 0.0000 1
178
+ ROS 0.8000 0.7059 0.7500 17
179
 
180
+ accuracy 0.7750 200
181
+ macro avg 0.5371 0.5240 0.4860 200
182
+ weighted avg 0.7675 0.7750 0.7494 200
183
  |
184
+ | 0.0296 | 5.0 | 860 | 0.4481 | precision recall f1-score support
185
 
186
  ALLERGY 1.0000 0.9167 0.9565 12
187
+ ASSESSMENT 0.4286 0.2727 0.3333 11
188
  CC 0.6250 0.4545 0.5263 11
189
  DIAGNOSIS 0.0000 0.0000 0.0000 1
190
  DISPOSITION 0.0000 0.0000 0.0000 1
191
+ EDCOURSE 0.0000 0.0000 0.0000 4
192
+ EXAM 1.0000 0.2000 0.3333 5
193
  FAM/SOCHX 0.8776 0.9556 0.9149 45
194
+ GENHX 0.7059 0.9057 0.7934 53
195
  GYNHX 0.0000 0.0000 0.0000 1
196
  IMAGING 0.0000 0.0000 0.0000 1
197
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
198
  LABS 0.0000 0.0000 0.0000 1
199
+ MEDICATIONS 0.7273 0.8000 0.7619 10
200
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
201
+ PASTMEDICALHX 0.6316 0.8571 0.7273 14
202
+ PASTSURGICAL 1.0000 1.0000 1.0000 7
203
  PLAN 0.0000 0.0000 0.0000 1
204
  PROCEDURES 0.0000 0.0000 0.0000 1
205
+ ROS 0.8000 0.7059 0.7500 17
206
 
207
  accuracy 0.7500 200
208
+ macro avg 0.3898 0.3534 0.3548 200
209
+ weighted avg 0.7110 0.7500 0.7169 200
210
  |
211
+ | 0.0158 | 6.0 | 1032 | 0.4526 | precision recall f1-score support
212
 
213
+ ALLERGY 1.0000 0.9167 0.9565 12
214
+ ASSESSMENT 0.4286 0.2727 0.3333 11
215
+ CC 0.6364 0.6364 0.6364 11
216
  DIAGNOSIS 0.0000 0.0000 0.0000 1
217
  DISPOSITION 0.0000 0.0000 0.0000 1
218
  EDCOURSE 0.0000 0.0000 0.0000 4
219
+ EXAM 0.3333 0.2000 0.2500 5
220
+ FAM/SOCHX 0.8462 0.9778 0.9072 45
221
+ GENHX 0.8571 0.9057 0.8807 53
222
  GYNHX 0.0000 0.0000 0.0000 1
223
  IMAGING 0.0000 0.0000 0.0000 1
224
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
225
  LABS 0.0000 0.0000 0.0000 1
226
  MEDICATIONS 0.7692 1.0000 0.8696 10
227
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
228
+ PASTMEDICALHX 0.6190 0.9286 0.7429 14
229
  PASTSURGICAL 0.8571 0.8571 0.8571 7
230
  PLAN 0.0000 0.0000 0.0000 1
231
  PROCEDURES 0.0000 0.0000 0.0000 1
232
+ ROS 0.7857 0.6471 0.7097 17
233
 
234
+ accuracy 0.7700 200
235
+ macro avg 0.3566 0.3671 0.3572 200
236
+ weighted avg 0.7230 0.7700 0.7403 200
237
  |
238
+ | 0.0158 | 7.0 | 1204 | 0.5002 | precision recall f1-score support
239
 
240
  ALLERGY 1.0000 0.9167 0.9565 12
241
+ ASSESSMENT 0.5000 0.1818 0.2667 11
242
+ CC 0.5000 0.6364 0.5600 11
243
  DIAGNOSIS 0.0000 0.0000 0.0000 1
244
  DISPOSITION 0.0000 0.0000 0.0000 1
245
  EDCOURSE 0.0000 0.0000 0.0000 4
246
+ EXAM 0.2500 0.2000 0.2222 5
247
+ FAM/SOCHX 0.8776 0.9556 0.9149 45
248
+ GENHX 0.7541 0.8679 0.8070 53
249
  GYNHX 0.0000 0.0000 0.0000 1
250
  IMAGING 0.0000 0.0000 0.0000 1
251
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
252
  LABS 0.0000 0.0000 0.0000 1
253
+ MEDICATIONS 0.7500 0.9000 0.8182 10
254
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
255
+ PASTMEDICALHX 0.6000 0.8571 0.7059 14
256
  PASTSURGICAL 1.0000 0.8571 0.9231 7
257
+ PLAN 0.3333 1.0000 0.5000 1
258
  PROCEDURES 0.0000 0.0000 0.0000 1
259
+ ROS 0.7500 0.5294 0.6207 17
260
 
261
  accuracy 0.7350 200
262
+ macro avg 0.3657 0.3951 0.3648 200
263
+ weighted avg 0.6985 0.7350 0.7060 200
264
  |
265
+ | 0.0158 | 8.0 | 1376 | 0.5027 | precision recall f1-score support
266
 
267
  ALLERGY 1.0000 0.9167 0.9565 12
268
+ ASSESSMENT 0.5714 0.3636 0.4444 11
269
+ CC 0.7143 0.4545 0.5556 11
270
  DIAGNOSIS 0.0000 0.0000 0.0000 1
271
+ DISPOSITION 0.0000 0.0000 0.0000 1
272
+ EDCOURSE 0.0000 0.0000 0.0000 4
273
+ EXAM 0.3333 0.2000 0.2500 5
274
+ FAM/SOCHX 0.8776 0.9556 0.9149 45
275
+ GENHX 0.7833 0.8868 0.8319 53
276
  GYNHX 0.0000 0.0000 0.0000 1
277
  IMAGING 0.0000 0.0000 0.0000 1
278
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
279
  LABS 0.0000 0.0000 0.0000 1
280
  MEDICATIONS 0.7692 1.0000 0.8696 10
281
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
282
+ PASTMEDICALHX 0.5714 0.8571 0.6857 14
283
+ PASTSURGICAL 0.7500 0.8571 0.8000 7
284
+ PLAN 0.3333 1.0000 0.5000 1
285
  PROCEDURES 0.0000 0.0000 0.0000 1
286
+ ROS 0.7692 0.5882 0.6667 17
287
 
288
  accuracy 0.7500 200
289
+ macro avg 0.3737 0.4040 0.3738 200
290
+ weighted avg 0.7158 0.7500 0.7236 200
291
  |
292
+ | 0.0088 | 9.0 | 1548 | 0.4827 | precision recall f1-score support
293
 
294
  ALLERGY 1.0000 0.9167 0.9565 12
295
+ ASSESSMENT 0.7143 0.4545 0.5556 11
296
+ CC 0.7143 0.4545 0.5556 11
297
  DIAGNOSIS 0.0000 0.0000 0.0000 1
298
  DISPOSITION 0.0000 0.0000 0.0000 1
299
  EDCOURSE 0.5000 0.2500 0.3333 4
300
  EXAM 0.5000 0.2000 0.2857 5
301
+ FAM/SOCHX 0.8600 0.9556 0.9053 45
302
+ GENHX 0.8246 0.8868 0.8545 53
303
  GYNHX 0.0000 0.0000 0.0000 1
304
  IMAGING 0.0000 0.0000 0.0000 1
305
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
306
  LABS 0.0000 0.0000 0.0000 1
307
  MEDICATIONS 0.7692 1.0000 0.8696 10
308
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
309
+ PASTMEDICALHX 0.5263 0.7143 0.6061 14
310
+ PASTSURGICAL 0.6364 1.0000 0.7778 7
311
+ PLAN 0.5000 1.0000 0.6667 1
312
  PROCEDURES 0.0000 0.0000 0.0000 1
313
+ ROS 0.7857 0.6471 0.7097 17
314
 
315
+ accuracy 0.7600 200
316
+ macro avg 0.4165 0.4240 0.4038 200
317
+ weighted avg 0.7399 0.7600 0.7392 200
318
  |
319
+ | 0.0088 | 10.0 | 1720 | 0.4749 | precision recall f1-score support
320
 
321
  ALLERGY 1.0000 0.9167 0.9565 12
322
+ ASSESSMENT 0.5714 0.3636 0.4444 11
323
+ CC 0.8571 0.5455 0.6667 11
324
  DIAGNOSIS 0.0000 0.0000 0.0000 1
325
+ DISPOSITION 0.0000 0.0000 0.0000 1
326
  EDCOURSE 0.0000 0.0000 0.0000 4
327
+ EXAM 0.3333 0.2000 0.2500 5
328
+ FAM/SOCHX 0.8750 0.9333 0.9032 45
329
+ GENHX 0.8182 0.8491 0.8333 53
330
  GYNHX 0.0000 0.0000 0.0000 1
331
+ IMAGING 1.0000 1.0000 1.0000 1
332
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
333
  LABS 0.0000 0.0000 0.0000 1
334
  MEDICATIONS 0.7692 1.0000 0.8696 10
335
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
336
+ PASTMEDICALHX 0.5000 0.9286 0.6500 14
337
+ PASTSURGICAL 0.7500 0.8571 0.8000 7
338
+ PLAN 0.3333 1.0000 0.5000 1
339
  PROCEDURES 0.0000 0.0000 0.0000 1
340
+ ROS 0.7692 0.5882 0.6667 17
341
 
342
  accuracy 0.7500 200
343
+ macro avg 0.4288 0.4591 0.4270 200
344
+ weighted avg 0.7324 0.7500 0.7300 200
345
  |
346
+ | 0.0088 | 11.0 | 1892 | 0.4876 | precision recall f1-score support
347
 
348
  ALLERGY 1.0000 0.9167 0.9565 12
349
+ ASSESSMENT 0.5556 0.4545 0.5000 11
350
+ CC 0.5556 0.4545 0.5000 11
351
  DIAGNOSIS 0.0000 0.0000 0.0000 1
352
  DISPOSITION 0.0000 0.0000 0.0000 1
353
  EDCOURSE 0.0000 0.0000 0.0000 4
354
+ EXAM 0.5000 0.2000 0.2857 5
355
+ FAM/SOCHX 0.8600 0.9556 0.9053 45
356
+ GENHX 0.8246 0.8868 0.8545 53
357
  GYNHX 0.0000 0.0000 0.0000 1
358
  IMAGING 0.0000 0.0000 0.0000 1
359
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
360
  LABS 0.0000 0.0000 0.0000 1
361
  MEDICATIONS 0.7692 1.0000 0.8696 10
362
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
363
+ PASTMEDICALHX 0.6471 0.7857 0.7097 14
364
+ PASTSURGICAL 0.7778 1.0000 0.8750 7
365
+ PLAN 0.3333 1.0000 0.5000 1
366
  PROCEDURES 0.0000 0.0000 0.0000 1
367
+ ROS 0.8000 0.7059 0.7500 17
368
 
369
+ accuracy 0.7650 200
370
+ macro avg 0.3812 0.4180 0.3853 200
371
+ weighted avg 0.7263 0.7650 0.7397 200
372
  |
373
+ | 0.0058 | 12.0 | 2064 | 0.5442 | precision recall f1-score support
374
 
375
  ALLERGY 1.0000 0.9167 0.9565 12
376
+ ASSESSMENT 0.5000 0.2727 0.3529 11
377
+ CC 0.8000 0.3636 0.5000 11
378
  DIAGNOSIS 0.0000 0.0000 0.0000 1
379
  DISPOSITION 0.0000 0.0000 0.0000 1
380
+ EDCOURSE 0.0000 0.0000 0.0000 4
381
+ EXAM 0.5000 0.2000 0.2857 5
382
+ FAM/SOCHX 0.8571 0.9333 0.8936 45
383
+ GENHX 0.7966 0.8868 0.8393 53
384
  GYNHX 0.0000 0.0000 0.0000 1
385
+ IMAGING 1.0000 1.0000 1.0000 1
386
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
387
  LABS 0.0000 0.0000 0.0000 1
388
  MEDICATIONS 0.7692 1.0000 0.8696 10
389
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
390
+ PASTMEDICALHX 0.5417 0.9286 0.6842 14
391
+ PASTSURGICAL 0.7500 0.8571 0.8000 7
392
+ PLAN 0.3333 1.0000 0.5000 1
393
  PROCEDURES 0.0000 0.0000 0.0000 1
394
+ ROS 0.7143 0.5882 0.6452 17
395
 
396
+ accuracy 0.7450 200
397
+ macro avg 0.4281 0.4474 0.4164 200
398
+ weighted avg 0.7180 0.7450 0.7166 200
399
  |
400
+ | 0.0058 | 13.0 | 2236 | 0.5125 | precision recall f1-score support
401
 
402
  ALLERGY 1.0000 0.9167 0.9565 12
403
  ASSESSMENT 0.5714 0.3636 0.4444 11
404
+ CC 0.5833 0.6364 0.6087 11
405
  DIAGNOSIS 0.0000 0.0000 0.0000 1
406
  DISPOSITION 0.0000 0.0000 0.0000 1
407
  EDCOURSE 0.0000 0.0000 0.0000 4
408
+ EXAM 0.5000 0.2000 0.2857 5
409
+ FAM/SOCHX 0.8600 0.9556 0.9053 45
410
+ GENHX 0.9020 0.8679 0.8846 53
411
  GYNHX 0.0000 0.0000 0.0000 1
412
+ IMAGING 1.0000 1.0000 1.0000 1
413
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
414
  LABS 0.0000 0.0000 0.0000 1
415
  MEDICATIONS 0.7692 1.0000 0.8696 10
416
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
417
+ PASTMEDICALHX 0.5909 0.9286 0.7222 14
418
+ PASTSURGICAL 0.7500 0.8571 0.8000 7
419
+ PLAN 0.3333 1.0000 0.5000 1
420
  PROCEDURES 0.0000 0.0000 0.0000 1
421
+ ROS 0.7857 0.6471 0.7097 17
422
 
423
  accuracy 0.7700 200
424
+ macro avg 0.4323 0.4686 0.4343 200
425
+ weighted avg 0.7481 0.7700 0.7504 200
426
  |
427
+ | 0.0058 | 14.0 | 2408 | 0.5206 | precision recall f1-score support
428
 
429
  ALLERGY 1.0000 0.9167 0.9565 12
430
+ ASSESSMENT 0.6000 0.2727 0.3750 11
431
+ CC 0.7143 0.4545 0.5556 11
432
  DIAGNOSIS 0.0000 0.0000 0.0000 1
433
  DISPOSITION 0.0000 0.0000 0.0000 1
434
+ EDCOURSE 0.0000 0.0000 0.0000 4
435
+ EXAM 0.3333 0.2000 0.2500 5
436
+ FAM/SOCHX 0.8600 0.9556 0.9053 45
437
+ GENHX 0.7966 0.8868 0.8393 53
438
+ GYNHX 0.0000 0.0000 0.0000 1
439
+ IMAGING 1.0000 1.0000 1.0000 1
440
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
441
+ LABS 0.0000 0.0000 0.0000 1
442
+ MEDICATIONS 0.7692 1.0000 0.8696 10
443
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
444
+ PASTMEDICALHX 0.6316 0.8571 0.7273 14
445
+ PASTSURGICAL 0.6667 0.8571 0.7500 7
446
+ PLAN 0.3333 1.0000 0.5000 1
447
+ PROCEDURES 0.0000 0.0000 0.0000 1
448
+ ROS 0.7500 0.7059 0.7273 17
449
+
450
+ accuracy 0.7600 200
451
+ macro avg 0.4228 0.4553 0.4228 200
452
+ weighted avg 0.7216 0.7600 0.7309 200
453
+ |
454
+ | 0.0038 | 15.0 | 2580 | 0.5211 | precision recall f1-score support
455
+
456
+ ALLERGY 1.0000 0.9167 0.9565 12
457
+ ASSESSMENT 0.4444 0.3636 0.4000 11
458
+ CC 0.5000 0.4545 0.4762 11
459
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
460
+ DISPOSITION 0.0000 0.0000 0.0000 1
461
+ EDCOURSE 0.0000 0.0000 0.0000 4
462
  EXAM 0.5000 0.2000 0.2857 5
463
+ FAM/SOCHX 0.8600 0.9556 0.9053 45
464
  GENHX 0.8364 0.8679 0.8519 53
465
  GYNHX 0.0000 0.0000 0.0000 1
466
+ IMAGING 1.0000 1.0000 1.0000 1
467
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
468
  LABS 0.0000 0.0000 0.0000 1
469
  MEDICATIONS 0.7692 1.0000 0.8696 10
470
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
471
+ PASTMEDICALHX 0.5714 0.8571 0.6857 14
472
+ PASTSURGICAL 1.0000 0.8571 0.9231 7
473
+ PLAN 0.3333 1.0000 0.5000 1
474
  PROCEDURES 0.0000 0.0000 0.0000 1
475
+ ROS 0.8000 0.7059 0.7500 17
476
 
477
+ accuracy 0.7600 200
478
+ macro avg 0.4307 0.4589 0.4302 200
479
+ weighted avg 0.7277 0.7600 0.7372 200
480
  |
481
+ | 0.0038 | 16.0 | 2752 | 0.5276 | precision recall f1-score support
482
 
483
  ALLERGY 1.0000 0.9167 0.9565 12
484
+ ASSESSMENT 0.5000 0.3636 0.4211 11
485
  CC 0.7143 0.4545 0.5556 11
486
  DIAGNOSIS 0.0000 0.0000 0.0000 1
487
  DISPOSITION 0.0000 0.0000 0.0000 1
488
+ EDCOURSE 0.0000 0.0000 0.0000 4
489
  EXAM 0.5000 0.2000 0.2857 5
490
+ FAM/SOCHX 0.8600 0.9556 0.9053 45
491
+ GENHX 0.8103 0.8868 0.8468 53
492
  GYNHX 0.0000 0.0000 0.0000 1
493
+ IMAGING 1.0000 1.0000 1.0000 1
494
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
495
  LABS 0.0000 0.0000 0.0000 1
496
  MEDICATIONS 0.7692 1.0000 0.8696 10
497
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
498
+ PASTMEDICALHX 0.5714 0.8571 0.6857 14
499
  PASTSURGICAL 1.0000 0.8571 0.9231 7
500
+ PLAN 0.3333 1.0000 0.5000 1
501
  PROCEDURES 0.0000 0.0000 0.0000 1
502
+ ROS 0.7500 0.7059 0.7273 17
503
 
504
+ accuracy 0.7650 200
505
+ macro avg 0.4404 0.4599 0.4338 200
506
+ weighted avg 0.7314 0.7650 0.7395 200
507
  |
508
+ | 0.0038 | 17.0 | 2924 | 0.4989 | precision recall f1-score support
509
 
510
  ALLERGY 1.0000 0.9167 0.9565 12
511
+ ASSESSMENT 0.4444 0.3636 0.4000 11
512
+ CC 0.5556 0.4545 0.5000 11
513
  DIAGNOSIS 0.0000 0.0000 0.0000 1
514
  DISPOSITION 0.0000 0.0000 0.0000 1
515
  EDCOURSE 0.0000 0.0000 0.0000 4
516
+ EXAM 0.5000 0.2000 0.2857 5
517
  FAM/SOCHX 0.8600 0.9556 0.9053 45
518
+ GENHX 0.8704 0.8868 0.8785 53
519
  GYNHX 0.0000 0.0000 0.0000 1
520
+ IMAGING 1.0000 1.0000 1.0000 1
521
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
522
  LABS 0.0000 0.0000 0.0000 1
523
  MEDICATIONS 0.7692 1.0000 0.8696 10
524
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
525
+ PASTMEDICALHX 0.6190 0.9286 0.7429 14
526
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
527
+ PLAN 0.3333 1.0000 0.5000 1
528
  PROCEDURES 0.0000 0.0000 0.0000 1
529
  ROS 0.8000 0.7059 0.7500 17
530
 
531
+ accuracy 0.7700 200
532
+ macro avg 0.4305 0.4634 0.4323 200
533
+ weighted avg 0.7381 0.7700 0.7473 200
534
  |
535
+ | 0.0025 | 18.0 | 3096 | 0.5121 | precision recall f1-score support
536
 
537
  ALLERGY 1.0000 0.9167 0.9565 12
538
+ ASSESSMENT 0.5000 0.3636 0.4211 11
539
+ CC 0.6250 0.4545 0.5263 11
540
  DIAGNOSIS 0.0000 0.0000 0.0000 1
541
  DISPOSITION 0.0000 0.0000 0.0000 1
542
  EDCOURSE 0.0000 0.0000 0.0000 4
543
+ EXAM 0.5000 0.2000 0.2857 5
544
+ FAM/SOCHX 0.8600 0.9556 0.9053 45
545
+ GENHX 0.8246 0.8868 0.8545 53
546
  GYNHX 0.0000 0.0000 0.0000 1
547
+ IMAGING 1.0000 1.0000 1.0000 1
548
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
549
  LABS 0.0000 0.0000 0.0000 1
550
  MEDICATIONS 0.7692 1.0000 0.8696 10
551
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
552
+ PASTMEDICALHX 0.6000 0.8571 0.7059 14
553
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
554
+ PLAN 0.3333 1.0000 0.5000 1
555
  PROCEDURES 0.0000 0.0000 0.0000 1
556
  ROS 0.8000 0.7059 0.7500 17
557
 
558
+ accuracy 0.7650 200
559
+ macro avg 0.4335 0.4599 0.4316 200
560
+ weighted avg 0.7315 0.7650 0.7409 200
561
  |
562
+ | 0.0025 | 19.0 | 3268 | 0.5190 | precision recall f1-score support
563
 
564
+ ALLERGY 1.0000 0.9167 0.9565 12
565
+ ASSESSMENT 0.4444 0.3636 0.4000 11
566
+ CC 0.6250 0.4545 0.5263 11
567
  DIAGNOSIS 0.0000 0.0000 0.0000 1
568
  DISPOSITION 0.0000 0.0000 0.0000 1
569
  EDCOURSE 0.0000 0.0000 0.0000 4
570
+ EXAM 0.5000 0.2000 0.2857 5
571
  FAM/SOCHX 0.8600 0.9556 0.9053 45
572
  GENHX 0.8246 0.8868 0.8545 53
573
  GYNHX 0.0000 0.0000 0.0000 1
574
+ IMAGING 1.0000 1.0000 1.0000 1
575
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
576
  LABS 0.0000 0.0000 0.0000 1
577
  MEDICATIONS 0.7692 1.0000 0.8696 10
578
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
579
+ PASTMEDICALHX 0.6000 0.8571 0.7059 14
580
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
581
+ PLAN 0.3333 1.0000 0.5000 1
582
  PROCEDURES 0.0000 0.0000 0.0000 1
583
  ROS 0.8000 0.7059 0.7500 17
584
 
585
+ accuracy 0.7650 200
586
+ macro avg 0.4307 0.4599 0.4305 200
587
+ weighted avg 0.7285 0.7650 0.7398 200
588
  |
589
+ | 0.0025 | 20.0 | 3440 | 0.5190 | precision recall f1-score support
590
 
591
+ ALLERGY 1.0000 0.9167 0.9565 12
592
+ ASSESSMENT 0.4444 0.3636 0.4000 11
593
+ CC 0.6250 0.4545 0.5263 11
594
  DIAGNOSIS 0.0000 0.0000 0.0000 1
595
  DISPOSITION 0.0000 0.0000 0.0000 1
596
  EDCOURSE 0.0000 0.0000 0.0000 4
597
+ EXAM 0.5000 0.2000 0.2857 5
598
  FAM/SOCHX 0.8600 0.9556 0.9053 45
599
  GENHX 0.8246 0.8868 0.8545 53
600
  GYNHX 0.0000 0.0000 0.0000 1
601
+ IMAGING 1.0000 1.0000 1.0000 1
602
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
603
  LABS 0.0000 0.0000 0.0000 1
604
  MEDICATIONS 0.7692 1.0000 0.8696 10
605
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
606
+ PASTMEDICALHX 0.6000 0.8571 0.7059 14
607
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
608
+ PLAN 0.3333 1.0000 0.5000 1
609
  PROCEDURES 0.0000 0.0000 0.0000 1
610
  ROS 0.8000 0.7059 0.7500 17
611
 
612
+ accuracy 0.7650 200
613
+ macro avg 0.4307 0.4599 0.4305 200
614
+ weighted avg 0.7285 0.7650 0.7398 200
615
  |
616
 
617
 
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c86750d8fd4e63223f8fbf2c984a8e25ea300c292c64b696dc294d5690134876
3
  size 307867048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6327f7ed220e872b0110668a77b3131b91328a23426c29582b7331944cb77d7d
3
  size 307867048
runs/Jan15_15-34-56_5d03746b44d6/events.out.tfevents.1705333995.5d03746b44d6.3518.1 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a4e1d3fdf6439e2fa60c261ed90478f9cfd190f3a864b369b40cb189fbe80126
3
- size 10880
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:413c4bf8614e75c9a8bfef7ef3334e853776efa6d4210bfc60eddf9115e3f6ed
3
+ size 12047