t5-dialogue-classification-3
This model is a fine-tuned version of google/flan-t5-base on an unknown dataset. It achieves the following results on the evaluation set:
Loss: 0.6484
Classification Report: precision recall f1-score support
ALLERGY 1.0000 0.9167 0.9565 12
ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.6667 0.5455 0.6000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.1667 1.0000 0.2857 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.4000 0.4000 0.4000 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.7895 0.8491 0.8182 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6000 0.8571 0.7059 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7647 0.7647 0.7647 17
accuracy 0.7550 200
macro avg 0.4525 0.5133 0.4657 200
weighted avg 0.7082 0.7550 0.7270 200
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 7
- eval_batch_size: 7
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 20
Training results
Training Loss | Epoch | Step | Validation Loss | Classification Report |
---|---|---|---|---|
No log | 1.0 | 172 | 0.3222 | precision recall f1-score support |
ALLERGY 1.0000 0.9167 0.9565 12
ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.4000 0.1818 0.2500 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.0000 0.0000 0.0000 5 FAM/SOCHX 0.8302 0.9778 0.8980 45 GENHX 0.5844 0.8491 0.6923 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.4000 0.7143 0.5128 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.3529 0.4615 17
accuracy 0.6750 200
macro avg 0.2795 0.2996 0.2807 200
weighted avg 0.5806 0.6750 0.6099 200 | | No log | 2.0 | 344 | 0.2356 | precision recall f1-score support
ALLERGY 1.0000 0.9167 0.9565 12
ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.3333 0.5455 0.4138 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2000 1.0000 0.3333 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 1.0000 0.2000 0.3333 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.7377 0.8491 0.7895 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5217 0.8571 0.6486 14 PASTSURGICAL 1.0000 0.8571 0.9231 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8462 0.6471 0.7333 17
accuracy 0.7250 200
macro avg 0.3651 0.3903 0.3457 200
weighted avg 0.6828 0.7250 0.6883 200 | | 0.3714 | 3.0 | 516 | 0.2994 | precision recall f1-score support
ALLERGY 1.0000 0.9167 0.9565 12
ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.4000 0.3636 0.3810 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.1818 0.4000 0.2500 5 FAM/SOCHX 0.8958 0.9556 0.9247 45 GENHX 0.7818 0.8113 0.7963 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5217 0.8571 0.6486 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7647 0.7647 0.7647 17
accuracy 0.7350 200
macro avg 0.4158 0.4535 0.4296 200
weighted avg 0.6803 0.7350 0.7026 200 | | 0.3714 | 4.0 | 688 | 0.3036 | precision recall f1-score support
ALLERGY 1.0000 0.9167 0.9565 12
ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.4167 0.4545 0.4348 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 1.0000 0.6667 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.2857 0.4000 0.3333 5 FAM/SOCHX 0.8958 0.9556 0.9247 45 GENHX 0.7667 0.8679 0.8142 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5238 0.7857 0.6286 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8462 0.6471 0.7333 17
accuracy 0.7450 200
macro avg 0.4440 0.5014 0.4647 200
weighted avg 0.6850 0.7450 0.7093 200 | | 0.3714 | 5.0 | 860 | 0.3366 | precision recall f1-score support
ALLERGY 1.0000 0.9167 0.9565 12
ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.3333 0.4545 0.3846 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2000 1.0000 0.3333 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.3333 0.4000 0.3636 5 FAM/SOCHX 0.8800 0.9778 0.9263 45 GENHX 0.8077 0.7925 0.8000 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5714 0.8571 0.6857 14 PASTSURGICAL 1.0000 0.7143 0.8333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7222 0.7647 0.7429 17
accuracy 0.7350 200
macro avg 0.4341 0.4939 0.4468 200
weighted avg 0.6878 0.7350 0.7055 200 | | 0.0843 | 6.0 | 1032 | 0.3852 | precision recall f1-score support
ALLERGY 1.0000 0.9167 0.9565 12
ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.4000 0.5455 0.4615 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.3333 1.0000 0.5000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.4000 0.4000 0.4000 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.8723 0.7736 0.8200 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5238 0.7857 0.6286 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.2500 1.0000 0.4000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7059 0.7059 0.7059 17
accuracy 0.7300 200
macro avg 0.4294 0.5530 0.4647 200
weighted avg 0.7036 0.7300 0.7105 200 | | 0.0843 | 7.0 | 1204 | 0.4632 | precision recall f1-score support
ALLERGY 1.0000 0.9167 0.9565 12
ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.7778 0.6364 0.7000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.4000 0.4000 0.4000 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.8696 0.7547 0.8081 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.4286 0.8571 0.5714 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6842 0.7647 0.7222 17
accuracy 0.7250 200
macro avg 0.3631 0.4131 0.3790 200
weighted avg 0.7072 0.7250 0.7083 200 | | 0.0843 | 8.0 | 1376 | 0.4287 | precision recall f1-score support
ALLERGY 1.0000 0.9167 0.9565 12
ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.5000 0.4545 0.4762 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 1.0000 0.4000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.4000 0.4000 0.4000 5 FAM/SOCHX 0.9130 0.9333 0.9231 45 GENHX 0.7759 0.8491 0.8108 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5714 0.8571 0.6857 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.7059 0.7500 17
accuracy 0.7450 200
macro avg 0.4272 0.5058 0.4489 200
weighted avg 0.7020 0.7450 0.7187 200 | | 0.0309 | 9.0 | 1548 | 0.4863 | precision recall f1-score support
ALLERGY 1.0000 0.9167 0.9565 12
ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.3571 0.4545 0.4000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 1.0000 0.4000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.3333 0.4000 0.3636 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.8182 0.8491 0.8333 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5500 0.7857 0.6471 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.7059 0.7742 17
accuracy 0.7400 200
macro avg 0.4384 0.5023 0.4565 200
weighted avg 0.7008 0.7400 0.7160 200 | | 0.0309 | 10.0 | 1720 | 0.5191 | precision recall f1-score support
ALLERGY 1.0000 0.9167 0.9565 12
ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.4286 0.5455 0.4800 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 1.0000 0.4000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.4000 0.4000 0.4000 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.8070 0.8679 0.8364 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6111 0.7857 0.6875 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.7059 0.7500 17
accuracy 0.7500 200
macro avg 0.4262 0.5077 0.4500 200
weighted avg 0.7047 0.7500 0.7235 200 | | 0.0309 | 11.0 | 1892 | 0.5932 | precision recall f1-score support
ALLERGY 1.0000 0.9167 0.9565 12
ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.5455 0.5455 0.5455 11 DIAGNOSIS 0.3333 1.0000 0.5000 1 DISPOSITION 0.2500 1.0000 0.4000 1 EDCOURSE 1.0000 0.2500 0.4000 4 EXAM 0.6667 0.4000 0.5000 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.8491 0.8491 0.8491 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5217 0.8571 0.6486 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8235 0.8235 0.8235 17
accuracy 0.7700 200
macro avg 0.5264 0.5788 0.5170 200
weighted avg 0.7413 0.7700 0.7444 200 | | 0.011 | 12.0 | 2064 | 0.5587 | precision recall f1-score support
ALLERGY 1.0000 0.9167 0.9565 12
ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.4615 0.5455 0.5000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 1.0000 0.6667 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.3333 0.4000 0.3636 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.8367 0.7736 0.8039 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5714 0.8571 0.6857 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6000 0.7059 0.6486 17
accuracy 0.7300 200
macro avg 0.4170 0.5066 0.4504 200
weighted avg 0.6866 0.7300 0.7034 200 | | 0.011 | 13.0 | 2236 | 0.5860 | precision recall f1-score support
ALLERGY 1.0000 0.9167 0.9565 12
ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.5455 0.5455 0.5455 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 1.0000 0.4000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.3333 0.4000 0.3636 5 FAM/SOCHX 0.8958 0.9556 0.9247 45 GENHX 0.8182 0.8491 0.8333 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5500 0.7857 0.6471 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.7059 0.7500 17
accuracy 0.7500 200
macro avg 0.4169 0.5079 0.4445 200
weighted avg 0.7011 0.7500 0.7209 200 | | 0.011 | 14.0 | 2408 | 0.6078 | precision recall f1-score support
ALLERGY 1.0000 0.9167 0.9565 12
ASSESSMENT 0.3333 0.0909 0.1429 11 CC 0.6000 0.5455 0.5714 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2000 1.0000 0.3333 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.3333 0.4000 0.3636 5 FAM/SOCHX 0.8776 0.9556 0.9149 45 GENHX 0.8113 0.8113 0.8113 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6667 0.8571 0.7500 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7059 0.7059 0.7059 17
accuracy 0.7500 200
macro avg 0.4399 0.5141 0.4543 200
weighted avg 0.7207 0.7500 0.7276 200 | | 0.0053 | 15.0 | 2580 | 0.6240 | precision recall f1-score support
ALLERGY 1.0000 0.9167 0.9565 12
ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.5455 0.5455 0.5455 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.1667 1.0000 0.2857 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.4000 0.4000 0.4000 5 FAM/SOCHX 0.8571 0.9333 0.8936 45 GENHX 0.8036 0.8491 0.8257 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6875 0.7857 0.7333 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7500 0.7059 0.7273 17
accuracy 0.7450 200
macro avg 0.4177 0.5068 0.4419 200
weighted avg 0.6951 0.7450 0.7163 200 | | 0.0053 | 16.0 | 2752 | 0.6298 | precision recall f1-score support
ALLERGY 1.0000 0.9167 0.9565 12
ASSESSMENT 0.2500 0.0909 0.1333 11 CC 0.6000 0.5455 0.5714 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 1.0000 0.4000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.3333 0.4000 0.3636 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.8302 0.8302 0.8302 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5238 0.7857 0.6286 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.7059 0.7500 17
accuracy 0.7450 200
macro avg 0.4313 0.5104 0.4508 200
weighted avg 0.7187 0.7450 0.7249 200 | | 0.0053 | 17.0 | 2924 | 0.6332 | precision recall f1-score support
ALLERGY 1.0000 0.9167 0.9565 12
ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.5455 0.5455 0.5455 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.1667 1.0000 0.2857 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.3333 0.4000 0.3636 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.8182 0.8491 0.8333 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5789 0.7857 0.6667 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.7059 0.7500 17
accuracy 0.7450 200
macro avg 0.4140 0.5068 0.4392 200
weighted avg 0.7022 0.7450 0.7191 200 | | 0.0029 | 18.0 | 3096 | 0.6371 | precision recall f1-score support
ALLERGY 1.0000 0.9167 0.9565 12
ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.6667 0.5455 0.6000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.1667 1.0000 0.2857 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.3333 0.4000 0.3636 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.8302 0.8302 0.8302 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5714 0.8571 0.6857 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7222 0.7647 0.7429 17
accuracy 0.7500 200
macro avg 0.4477 0.5124 0.4624 200
weighted avg 0.7117 0.7500 0.7260 200 | | 0.0029 | 19.0 | 3268 | 0.6497 | precision recall f1-score support
ALLERGY 1.0000 0.9167 0.9565 12
ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.6667 0.5455 0.6000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.1667 1.0000 0.2857 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.4000 0.4000 0.4000 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.8036 0.8491 0.8257 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5714 0.8571 0.6857 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7647 0.7647 0.7647 17
accuracy 0.7550 200
macro avg 0.4518 0.5133 0.4650 200
weighted avg 0.7100 0.7550 0.7275 200 | | 0.0029 | 20.0 | 3440 | 0.6484 | precision recall f1-score support
ALLERGY 1.0000 0.9167 0.9565 12
ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.6667 0.5455 0.6000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.1667 1.0000 0.2857 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.4000 0.4000 0.4000 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.7895 0.8491 0.8182 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6000 0.8571 0.7059 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7647 0.7647 0.7647 17
accuracy 0.7550 200
macro avg 0.4525 0.5133 0.4657 200
weighted avg 0.7082 0.7550 0.7270 200 |
Framework versions
- Transformers 4.35.2
- Pytorch 2.1.0+cu121
- Datasets 2.16.1
- Tokenizers 0.15.0
- Downloads last month
- 2
Model tree for sarahahtee/t5-dialogue-classification-3
Base model
google/flan-t5-base