Edit model card

t5-dialogue-classification-5

This model is a fine-tuned version of google/flan-t5-base on an unknown dataset. It achieves the following results on the evaluation set:

  • Loss: 0.6676

  • Classification Report: precision recall f1-score support

    ALLERGY     1.0000    0.2500    0.4000         4
    

    ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8462 1.0000 0.9167 22 GENHX 0.7037 0.9500 0.8085 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.2500 1.0000 0.4000 1

IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7500 0.8571 0.8000 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.6667 1.0000 0.8000 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8333 0.4545 0.5882 11

 accuracy                         0.7200       100
macro avg     0.4525    0.4798    0.4357       100

weighted avg 0.6752 0.7200 0.6721 100

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 0.0001
  • train_batch_size: 7
  • eval_batch_size: 7
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 20

Training results

Training Loss Epoch Step Validation Loss Classification Report
No log 1.0 172 0.5114 precision recall f1-score support
  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.6667 1.0000 0.8000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.7778 0.9545 0.8571 22 GENHX 0.4595 0.8500 0.5965 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.5714 0.5714 0.5714 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.3636 1.0000 0.5333 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.0000 0.0000 0.0000 11 SYSTEMS 0.0000 0.0000 0.0000 0

 accuracy                         0.6000       100
macro avg     0.2780    0.3155    0.2742       100

weighted avg 0.4742 0.6000 0.5072 100 | | No log | 2.0 | 344 | 0.3955 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.2500 0.3333 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.8750 0.9545 0.9130 22 GENHX 0.4878 1.0000 0.6557 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6667 0.8571 0.7500 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5714 1.0000 0.7273 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11

 accuracy                         0.6400       100
macro avg     0.3384    0.3247    0.3033       100

weighted avg 0.5829 0.6400 0.5644 100 | | 0.3535 | 3.0 | 516 | 0.3595 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.6000 0.7500 0.6667 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.9000 0.8182 0.8571 22 GENHX 0.6061 1.0000 0.7547 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.3636 0.5000 11

 accuracy                         0.6500       100
macro avg     0.3516    0.3948    0.3423       100

weighted avg 0.6250 0.6500 0.6038 100 | | 0.3535 | 4.0 | 688 | 0.3475 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.0000 0.0000 0.0000 4 Accutane 0.0000 0.0000 0.0000 0 CC 1.0000 0.7500 0.8571 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.2500 1.0000 0.4000 1 FAM/SOCHX 0.8077 0.9545 0.8750 22 GENHX 0.8000 1.0000 0.8889 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.2000 1.0000 0.3333 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11

 accuracy                         0.7000       100
macro avg     0.3352    0.3912    0.3216       100

weighted avg 0.6602 0.7000 0.6546 100 | | 0.3535 | 5.0 | 860 | 0.3449 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.5000 0.2500 0.3333 4 Accutane 0.0000 0.0000 0.0000 0 CC 1.0000 0.7500 0.8571 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8750 0.9545 0.9130 22 GENHX 0.7692 1.0000 0.8696 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5714 1.0000 0.7273 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7200       100
macro avg     0.4388    0.4074    0.4049       100

weighted avg 0.7092 0.7200 0.6952 100 | | 0.0876 | 6.0 | 1032 | 0.3894 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.5000 0.2500 0.3333 4 Accutane 0.0000 0.0000 0.0000 0 CC 1.0000 0.5000 0.6667 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 0.5000 0.5000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.9091 0.9091 0.9091 22 GENHX 0.6552 0.9500 0.7755 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4444 1.0000 0.6154 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7100       100
macro avg     0.4570    0.4306    0.4151       100

weighted avg 0.7151 0.7100 0.6854 100 | | 0.0876 | 7.0 | 1204 | 0.3929 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.5000 0.2500 0.3333 4 Accutane 0.0000 0.0000 0.0000 0 CC 0.6667 0.5000 0.5714 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.3333 1.0000 0.5000 1 FAM/SOCHX 0.8077 0.9545 0.8750 22 GENHX 0.7600 0.9500 0.8444 20 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.2500 1.0000 0.4000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5714 1.0000 0.7273 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 1.0000 0.3333 0.5000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8333 0.4545 0.5882 11

 accuracy                         0.7000       100
macro avg     0.4494    0.4479    0.4026       100

weighted avg 0.7067 0.7000 0.6714 100 | | 0.0876 | 8.0 | 1376 | 0.5449 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.7500 0.7500 0.7500 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.3333 0.5000 0.4000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8750 0.9545 0.9130 22 GENHX 0.7500 0.9000 0.8182 20 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.3333 1.0000 0.5000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6364 1.0000 0.7778 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.3333 1.0000 0.5000 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7500 0.2727 0.4000 11

 accuracy                         0.7100       100
macro avg     0.5131    0.5480    0.4930       100

weighted avg 0.6879 0.7100 0.6640 100 | | 0.0355 | 9.0 | 1548 | 0.5615 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 1.0000 0.2500 0.4000 4 Accutane 0.0000 0.0000 0.0000 0 CC 0.7500 0.7500 0.7500 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8800 1.0000 0.9362 22 GENHX 0.6333 0.9500 0.7600 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.6667 1.0000 0.8000 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 1.0000 0.3333 0.5000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.3636 0.5000 11

 accuracy                         0.7000       100
macro avg     0.4973    0.4101    0.4172       100

weighted avg 0.7249 0.7000 0.6720 100 | | 0.0355 | 10.0 | 1720 | 0.5021 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.5000 0.2500 0.3333 4 Accutane 0.0000 0.0000 0.0000 0 CC 0.7500 0.7500 0.7500 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8462 1.0000 0.9167 22 GENHX 0.7308 0.9500 0.8261 20 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.2500 1.0000 0.4000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5714 1.0000 0.7273 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.3636 0.5000 11

 accuracy                         0.7200       100
macro avg     0.5077    0.5053    0.4746       100

weighted avg 0.7107 0.7200 0.6863 100 | | 0.0355 | 11.0 | 1892 | 0.5690 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 1.0000 0.2500 0.4000 4 Accutane 0.0000 0.0000 0.0000 0 CC 1.0000 0.7500 0.8571 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 0.5000 0.3333 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.9565 1.0000 0.9778 22 GENHX 0.6667 1.0000 0.8000 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.2500 1.0000 0.4000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.6667 1.0000 0.8000 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11

 accuracy                         0.7500       100
macro avg     0.5172    0.4925    0.4642       100

weighted avg 0.7572 0.7500 0.7194 100 | | 0.012 | 12.0 | 2064 | 0.6739 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 1.0000 0.5000 0.6667 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 0.5000 0.3333 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.9130 0.9545 0.9333 22 GENHX 0.6061 1.0000 0.7547 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.2500 1.0000 0.4000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.6667 1.0000 0.8000 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11

 accuracy                         0.7200       100
macro avg     0.4879    0.4899    0.4535       100

weighted avg 0.6955 0.7200 0.6769 100 | | 0.012 | 13.0 | 2236 | 0.6173 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8800 1.0000 0.9362 22 GENHX 0.6786 0.9500 0.7917 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.2500 1.0000 0.4000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.6667 1.0000 0.8000 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8333 0.4545 0.5882 11

 accuracy                         0.7100       100
macro avg     0.4511    0.4726    0.4315       100

weighted avg 0.6751 0.7100 0.6670 100 | | 0.012 | 14.0 | 2408 | 0.6580 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 0.5000 0.3333 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.9130 0.9545 0.9333 22 GENHX 0.6333 0.9500 0.7600 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.2500 1.0000 0.4000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.6667 1.0000 0.8000 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8333 0.4545 0.5882 11

 accuracy                         0.7100       100
macro avg     0.4630    0.4953    0.4465       100

weighted avg 0.6784 0.7100 0.6667 100 | | 0.0086 | 15.0 | 2580 | 0.6118 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 0.5000 0.3333 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8800 1.0000 0.9362 22 GENHX 0.7037 0.9500 0.8085 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.2500 1.0000 0.4000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.6667 1.0000 0.8000 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8333 0.4545 0.5882 11

 accuracy                         0.7400       100
macro avg     0.4681    0.5119    0.4571       100

weighted avg 0.6896 0.7400 0.6883 100 | | 0.0086 | 16.0 | 2752 | 0.6210 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.7500 0.7500 0.7500 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 0.5000 0.3333 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8750 0.9545 0.9130 22 GENHX 0.7143 1.0000 0.8333 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.2500 1.0000 0.4000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7500 0.8571 0.8000 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5714 1.0000 0.7273 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11

 accuracy                         0.7400       100
macro avg     0.4759    0.5095    0.4612       100

weighted avg 0.6975 0.7400 0.6946 100 | | 0.0086 | 17.0 | 2924 | 0.6166 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.6667 0.5000 0.5714 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8400 0.9545 0.8936 22 GENHX 0.7037 0.9500 0.8085 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.2000 1.0000 0.3333 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7500 0.8571 0.8000 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5714 1.0000 0.7273 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11

 accuracy                         0.7100       100
macro avg     0.4544    0.4695    0.4300       100

weighted avg 0.6789 0.7100 0.6709 100 | | 0.0025 | 18.0 | 3096 | 0.6372 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.6000 0.7500 0.6667 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8462 1.0000 0.9167 22 GENHX 0.6786 0.9500 0.7917 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.2500 1.0000 0.4000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7500 0.8571 0.8000 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.6667 1.0000 0.8000 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8333 0.4545 0.5882 11

 accuracy                         0.7200       100
macro avg     0.4562    0.4798    0.4382       100

weighted avg 0.6742 0.7200 0.6714 100 | | 0.0025 | 19.0 | 3268 | 0.6598 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.6000 0.7500 0.6667 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8462 1.0000 0.9167 22 GENHX 0.6786 0.9500 0.7917 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.2500 1.0000 0.4000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7500 0.8571 0.8000 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.6667 1.0000 0.8000 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8333 0.4545 0.5882 11

 accuracy                         0.7200       100
macro avg     0.4562    0.4798    0.4382       100

weighted avg 0.6742 0.7200 0.6714 100 | | 0.0025 | 20.0 | 3440 | 0.6676 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8462 1.0000 0.9167 22 GENHX 0.7037 0.9500 0.8085 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.2500 1.0000 0.4000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7500 0.8571 0.8000 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.6667 1.0000 0.8000 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8333 0.4545 0.5882 11

 accuracy                         0.7200       100
macro avg     0.4525    0.4798    0.4357       100

weighted avg 0.6752 0.7200 0.6721 100 |

Framework versions

  • Transformers 4.38.2
  • Pytorch 2.1.0+cu121
  • Datasets 2.18.0
  • Tokenizers 0.15.2
Downloads last month
3
Safetensors
Model size
248M params
Tensor type
F32
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for kmanaa/t5-dialogue-classification-5

Finetuned
(624)
this model