Hugging Face's logo

matchten
/
text-message-analyzer-finetuned

Text Classification
Transformers
TensorBoard
Safetensors
roberta
Generated from Trainer
Eval Results
Inference Endpoints
Model card Files Metrics Community
text-message-analyzer-finetuned / README.md
matchten's picture
matchten
End of training
4c078b7
preview code
|
raw
history blame
19 kB
metadata
base_model: cardiffnlp/twitter-roberta-base-sentiment-latest
tags:
  - generated_from_trainer
datasets:
  - daily_dialog
metrics:
  - accuracy
  - f1
  - precision
  - recall
model-index:
  - name: text-message-analyzer-finetuned
    results:
      - task:
          name: Text Classification
          type: text-classification
        dataset:
          name: daily_dialog
          type: daily_dialog
          config: default
          split: validation
          args: default
        metrics:
          - name: Accuracy
            type: accuracy
            value: 0.762
          - name: F1
            type: f1
            value: 0.7650409655164931
          - name: Precision
            type: precision
            value: 0.7705665981905709
          - name: Recall
            type: recall
            value: 0.762

text-message-analyzer-finetuned

This model is a fine-tuned version of cardiffnlp/twitter-roberta-base-sentiment-latest on the daily_dialog dataset. It achieves the following results on the evaluation set:

  • Loss: 0.5913
  • Accuracy: 0.762
  • F1: 0.7650
  • Precision: 0.7706
  • Recall: 0.762

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5e-05
  • train_batch_size: 15
  • eval_batch_size: 8
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 1

Training results

Training Loss Epoch Step Validation Loss Accuracy F1 Precision Recall
No log 0.01 5 0.8666 0.589 0.5903 0.6104 0.589
No log 0.01 10 0.7596 0.661 0.6590 0.6603 0.661
No log 0.02 15 1.1783 0.521 0.5244 0.7242 0.521
No log 0.02 20 0.8909 0.615 0.6318 0.6910 0.615
No log 0.03 25 0.7995 0.666 0.6743 0.6918 0.666
No log 0.03 30 0.7699 0.65 0.6585 0.6935 0.65
No log 0.04 35 0.7344 0.662 0.6691 0.6857 0.662
No log 0.04 40 0.7326 0.654 0.6675 0.7036 0.654
No log 0.05 45 0.9608 0.603 0.5705 0.7211 0.603
No log 0.05 50 0.8593 0.628 0.6338 0.7262 0.628
No log 0.06 55 0.8635 0.626 0.6066 0.7400 0.626
No log 0.07 60 0.7101 0.682 0.6782 0.6911 0.682
No log 0.07 65 0.7569 0.67 0.6780 0.7067 0.67
No log 0.08 70 0.7694 0.653 0.6608 0.7271 0.653
No log 0.08 75 0.6941 0.691 0.6925 0.7202 0.691
No log 0.09 80 0.8646 0.606 0.6168 0.7450 0.606
No log 0.09 85 0.6853 0.677 0.6895 0.7369 0.677
No log 0.1 90 0.6410 0.727 0.7264 0.7272 0.727
No log 0.1 95 0.7059 0.693 0.7020 0.7410 0.693
No log 0.11 100 0.7398 0.665 0.6734 0.7441 0.665
No log 0.11 105 0.7205 0.683 0.6884 0.7243 0.683
No log 0.12 110 0.7492 0.661 0.6741 0.7410 0.661
No log 0.12 115 0.7273 0.676 0.6932 0.7388 0.676
No log 0.13 120 0.6670 0.678 0.6853 0.7079 0.678
No log 0.14 125 0.7238 0.663 0.6707 0.7348 0.663
No log 0.14 130 0.7109 0.68 0.6948 0.7333 0.68
No log 0.15 135 0.6813 0.685 0.6832 0.7324 0.685
No log 0.15 140 0.6859 0.692 0.7002 0.7304 0.692
No log 0.16 145 0.7968 0.622 0.6231 0.7268 0.622
No log 0.16 150 0.6754 0.695 0.7022 0.7212 0.695
No log 0.17 155 0.6520 0.698 0.6981 0.7296 0.698
No log 0.17 160 0.6198 0.726 0.7282 0.7334 0.726
No log 0.18 165 0.6745 0.703 0.6974 0.7346 0.703
No log 0.18 170 0.6724 0.707 0.7182 0.7486 0.707
No log 0.19 175 0.7787 0.636 0.6392 0.7409 0.636
No log 0.2 180 0.7098 0.667 0.6663 0.7338 0.667
No log 0.2 185 0.6340 0.728 0.7290 0.7340 0.728
No log 0.21 190 0.6561 0.698 0.7023 0.7229 0.698
No log 0.21 195 0.6790 0.678 0.6804 0.7318 0.678
No log 0.22 200 0.7213 0.654 0.6497 0.7337 0.654
No log 0.22 205 0.7410 0.652 0.6609 0.7242 0.652
No log 0.23 210 0.6848 0.703 0.7084 0.7332 0.703
No log 0.23 215 0.6946 0.689 0.6796 0.7291 0.689
No log 0.24 220 0.7092 0.674 0.6870 0.7311 0.674
No log 0.24 225 0.6285 0.705 0.7085 0.7295 0.705
No log 0.25 230 0.6449 0.696 0.6990 0.7166 0.696
No log 0.25 235 0.7303 0.671 0.6694 0.7366 0.671
No log 0.26 240 0.7583 0.67 0.6822 0.7399 0.67
No log 0.27 245 0.7154 0.678 0.6866 0.7443 0.678
No log 0.27 250 0.7337 0.686 0.6852 0.7369 0.686
No log 0.28 255 0.6486 0.711 0.7136 0.7362 0.711
No log 0.28 260 0.6231 0.736 0.7350 0.7410 0.736
No log 0.29 265 0.6963 0.709 0.7211 0.7532 0.709
No log 0.29 270 0.6847 0.693 0.7028 0.7403 0.693
No log 0.3 275 0.6581 0.696 0.6969 0.7464 0.696
No log 0.3 280 0.6182 0.702 0.7061 0.7187 0.702
No log 0.31 285 0.6653 0.682 0.6898 0.7144 0.682
No log 0.31 290 0.6917 0.699 0.7091 0.7372 0.699
No log 0.32 295 0.6722 0.704 0.7067 0.7285 0.704
No log 0.33 300 0.6582 0.703 0.7073 0.7238 0.703
No log 0.33 305 0.6568 0.687 0.6934 0.7146 0.687
No log 0.34 310 0.6912 0.665 0.6605 0.7292 0.665
No log 0.34 315 0.6223 0.71 0.7119 0.7311 0.71
No log 0.35 320 0.6409 0.714 0.7146 0.7244 0.714
No log 0.35 325 0.7169 0.689 0.7023 0.7385 0.689
No log 0.36 330 0.7887 0.649 0.6580 0.7435 0.649
No log 0.36 335 0.6594 0.694 0.6987 0.7111 0.694
No log 0.37 340 0.6559 0.713 0.7121 0.7137 0.713
No log 0.37 345 0.6490 0.686 0.6927 0.7076 0.686
No log 0.38 350 0.6964 0.67 0.6837 0.7424 0.67
No log 0.39 355 0.7011 0.669 0.6873 0.7460 0.669
No log 0.39 360 0.6987 0.668 0.6875 0.7409 0.668
No log 0.4 365 0.6375 0.696 0.7057 0.7340 0.696
No log 0.4 370 0.6365 0.695 0.6972 0.7270 0.695
No log 0.41 375 0.6212 0.712 0.7190 0.7488 0.712
No log 0.41 380 0.7102 0.667 0.6770 0.7532 0.667
No log 0.42 385 0.7385 0.66 0.6616 0.7498 0.66
No log 0.42 390 0.6221 0.723 0.7276 0.7533 0.723
No log 0.43 395 0.6174 0.74 0.7469 0.7651 0.74
No log 0.43 400 0.6092 0.748 0.7538 0.7644 0.748
No log 0.44 405 0.5978 0.737 0.7412 0.7483 0.737
No log 0.44 410 0.6645 0.697 0.6964 0.7402 0.697
No log 0.45 415 0.7153 0.67 0.6654 0.7372 0.67
No log 0.46 420 0.6236 0.728 0.7343 0.7560 0.728
No log 0.46 425 0.7162 0.682 0.6915 0.7441 0.682
No log 0.47 430 0.6658 0.712 0.7228 0.7530 0.712
No log 0.47 435 0.6350 0.725 0.7326 0.7535 0.725
No log 0.48 440 0.5977 0.725 0.7293 0.7378 0.725
No log 0.48 445 0.5900 0.722 0.7246 0.7312 0.722
No log 0.49 450 0.5993 0.716 0.7198 0.7327 0.716
No log 0.49 455 0.6322 0.711 0.7189 0.7450 0.711
No log 0.5 460 0.7598 0.668 0.6824 0.7507 0.668
No log 0.5 465 0.7033 0.7 0.7133 0.7620 0.7
No log 0.51 470 0.6343 0.726 0.7348 0.7525 0.726
No log 0.52 475 0.6080 0.729 0.7352 0.7507 0.729
No log 0.52 480 0.5939 0.741 0.7455 0.7539 0.741
No log 0.53 485 0.6038 0.739 0.7448 0.7560 0.739
No log 0.53 490 0.6240 0.734 0.7386 0.7566 0.734
No log 0.54 495 0.6442 0.724 0.7323 0.7560 0.724
0.7055 0.54 500 0.7067 0.71 0.7237 0.7583 0.71
0.7055 0.55 505 0.7353 0.704 0.7133 0.7484 0.704
0.7055 0.55 510 0.6534 0.733 0.7377 0.7475 0.733
0.7055 0.56 515 0.7046 0.729 0.7315 0.7533 0.729
0.7055 0.56 520 0.7140 0.711 0.7130 0.7487 0.711
0.7055 0.57 525 0.6423 0.716 0.7193 0.7443 0.716
0.7055 0.57 530 0.6074 0.733 0.7377 0.7481 0.733
0.7055 0.58 535 0.6066 0.735 0.7405 0.7513 0.735
0.7055 0.59 540 0.5945 0.732 0.7374 0.7486 0.732
0.7055 0.59 545 0.6231 0.705 0.7112 0.7439 0.705
0.7055 0.6 550 0.6108 0.737 0.7460 0.7660 0.737
0.7055 0.6 555 0.5846 0.754 0.7572 0.7675 0.754
0.7055 0.61 560 0.5965 0.748 0.7496 0.7640 0.748
0.7055 0.61 565 0.5849 0.753 0.7577 0.7687 0.753
0.7055 0.62 570 0.6037 0.723 0.7269 0.7514 0.723
0.7055 0.62 575 0.5773 0.742 0.7455 0.7598 0.742
0.7055 0.63 580 0.5661 0.751 0.7545 0.7607 0.751
0.7055 0.63 585 0.5717 0.752 0.7555 0.7626 0.752
0.7055 0.64 590 0.5905 0.762 0.7674 0.7808 0.762
0.7055 0.65 595 0.5876 0.759 0.7649 0.7773 0.759
0.7055 0.65 600 0.5651 0.77 0.7717 0.7741 0.77
0.7055 0.66 605 0.5791 0.748 0.7465 0.7502 0.748
0.7055 0.66 610 0.6135 0.721 0.7210 0.7434 0.721
0.7055 0.67 615 0.6268 0.723 0.7242 0.7523 0.723
0.7055 0.67 620 0.6211 0.71 0.7106 0.7449 0.71
0.7055 0.68 625 0.5829 0.757 0.7607 0.7742 0.757
0.7055 0.68 630 0.5718 0.765 0.7681 0.7744 0.765
0.7055 0.69 635 0.5685 0.775 0.7769 0.7830 0.775
0.7055 0.69 640 0.5731 0.752 0.7545 0.7653 0.752
0.7055 0.7 645 0.5903 0.733 0.7356 0.7570 0.733
0.7055 0.7 650 0.5973 0.73 0.7327 0.7575 0.73
0.7055 0.71 655 0.6056 0.72 0.7213 0.7535 0.72
0.7055 0.72 660 0.5617 0.763 0.7648 0.7703 0.763
0.7055 0.72 665 0.5781 0.761 0.7576 0.7688 0.761
0.7055 0.73 670 0.5993 0.745 0.7409 0.7650 0.745
0.7055 0.73 675 0.6027 0.746 0.7504 0.7675 0.746
0.7055 0.74 680 0.5825 0.751 0.7534 0.7600 0.751
0.7055 0.74 685 0.5742 0.745 0.7469 0.7513 0.745
0.7055 0.75 690 0.5907 0.731 0.7313 0.7462 0.731
0.7055 0.75 695 0.6017 0.734 0.7340 0.7555 0.734
0.7055 0.76 700 0.5767 0.746 0.7477 0.7599 0.746
0.7055 0.76 705 0.5859 0.747 0.7510 0.7676 0.747
0.7055 0.77 710 0.6001 0.747 0.7518 0.7690 0.747
0.7055 0.78 715 0.6427 0.719 0.7233 0.7541 0.719
0.7055 0.78 720 0.6600 0.72 0.7247 0.7556 0.72
0.7055 0.79 725 0.6365 0.744 0.7468 0.7640 0.744
0.7055 0.79 730 0.6089 0.754 0.7555 0.7596 0.754
0.7055 0.8 735 0.6050 0.749 0.7484 0.7494 0.749
0.7055 0.8 740 0.6120 0.745 0.7442 0.7518 0.745
0.7055 0.81 745 0.6205 0.736 0.7356 0.7490 0.736
0.7055 0.81 750 0.6174 0.737 0.7376 0.7544 0.737
0.7055 0.82 755 0.6222 0.733 0.7358 0.7585 0.733
0.7055 0.82 760 0.6216 0.737 0.7428 0.7636 0.737
0.7055 0.83 765 0.6138 0.749 0.7548 0.7691 0.749
0.7055 0.84 770 0.5977 0.76 0.7628 0.7682 0.76
0.7055 0.84 775 0.5930 0.762 0.7639 0.7671 0.762
0.7055 0.85 780 0.6002 0.762 0.7632 0.7682 0.762
0.7055 0.85 785 0.6029 0.76 0.7621 0.7676 0.76
0.7055 0.86 790 0.6068 0.751 0.7544 0.7615 0.751
0.7055 0.86 795 0.6188 0.746 0.7508 0.7615 0.746
0.7055 0.87 800 0.6398 0.725 0.7300 0.7486 0.725
0.7055 0.87 805 0.6555 0.717 0.7205 0.7461 0.717
0.7055 0.88 810 0.6550 0.726 0.7282 0.7578 0.726
0.7055 0.88 815 0.6376 0.726 0.7283 0.7474 0.726
0.7055 0.89 820 0.6115 0.741 0.7436 0.7524 0.741
0.7055 0.89 825 0.6048 0.756 0.7583 0.7638 0.756
0.7055 0.9 830 0.6039 0.753 0.7548 0.7591 0.753
0.7055 0.91 835 0.6018 0.754 0.7559 0.7605 0.754
0.7055 0.91 840 0.5967 0.757 0.7597 0.7653 0.757
0.7055 0.92 845 0.5937 0.766 0.7687 0.7738 0.766
0.7055 0.92 850 0.5945 0.766 0.7689 0.7740 0.766
0.7055 0.93 855 0.5951 0.764 0.7669 0.7722 0.764
0.7055 0.93 860 0.5953 0.761 0.7640 0.7699 0.761
0.7055 0.94 865 0.5977 0.762 0.7651 0.7726 0.762
0.7055 0.94 870 0.5969 0.763 0.7659 0.7733 0.763
0.7055 0.95 875 0.5957 0.764 0.7667 0.7740 0.764
0.7055 0.95 880 0.5927 0.762 0.7650 0.7717 0.762
0.7055 0.96 885 0.5916 0.763 0.7660 0.7715 0.763
0.7055 0.97 890 0.5935 0.762 0.7654 0.7717 0.762
0.7055 0.97 895 0.5934 0.759 0.7625 0.7689 0.759
0.7055 0.98 900 0.5919 0.763 0.7660 0.7715 0.763
0.7055 0.98 905 0.5913 0.762 0.7650 0.7705 0.762
0.7055 0.99 910 0.5916 0.764 0.7671 0.7726 0.764
0.7055 0.99 915 0.5916 0.762 0.7650 0.7706 0.762
0.7055 1.0 920 0.5913 0.762 0.7650 0.7706 0.762

Framework versions

  • Transformers 4.35.2
  • Pytorch 2.1.0+cu118
  • Datasets 2.15.0
  • Tokenizers 0.15.0