finetune-led-thousanddata
This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:
- Loss: 1.9539
- Rouge1 Precision: 0.2722
- Rouge1 Recall: 0.3458
- Rouge1 Fmeasure: 0.3011
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- gradient_accumulation_steps: 4
- total_train_batch_size: 32
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 4
- mixed_precision_training: Native AMP
Training results
Training Loss | Epoch | Step | Validation Loss | Rouge1 Fmeasure | Rouge1 Precision | Rouge1 Recall |
---|---|---|---|---|---|---|
2.0529 | 0.13 | 10 | 2.6191 | 0.3014 | 0.2948 | 0.324 |
1.778 | 0.26 | 20 | 2.4690 | 0.2947 | 0.2802 | 0.3213 |
1.7425 | 0.38 | 30 | 2.3989 | 0.3037 | 0.2734 | 0.3524 |
1.7006 | 0.51 | 40 | 2.3216 | 0.2941 | 0.2665 | 0.3386 |
1.6751 | 0.64 | 50 | 2.3027 | 0.3101 | 0.282 | 0.3551 |
1.6887 | 0.77 | 60 | 2.2911 | 0.3058 | 0.2731 | 0.3577 |
1.6008 | 0.89 | 70 | 2.2476 | 0.3016 | 0.272 | 0.3487 |
1.5767 | 1.02 | 80 | 2.2167 | 0.3043 | 0.2775 | 0.3465 |
1.5046 | 1.15 | 90 | 2.2185 | 0.3004 | 0.2721 | 0.3458 |
1.5394 | 1.28 | 100 | 2.1977 | 0.2991 | 0.2696 | 0.3463 |
1.5449 | 1.41 | 110 | 2.1823 | 0.2978 | 0.2704 | 0.341 |
1.5073 | 1.53 | 120 | 2.1832 | 0.3057 | 0.276 | 0.3527 |
1.5232 | 0.42 | 130 | 2.2091 | 0.2955 | 0.2664 | 0.3424 |
1.4896 | 0.45 | 140 | 2.2069 | 0.2905 | 0.2574 | 0.3424 |
1.4848 | 0.48 | 150 | 2.1913 | 0.2868 | 0.2567 | 0.3356 |
1.5084 | 0.51 | 160 | 2.1826 | 0.3006 | 0.2755 | 0.3406 |
1.4322 | 0.54 | 170 | 2.2525 | 0.3049 | 0.2716 | 0.3582 |
1.4672 | 0.58 | 180 | 2.1890 | 0.2919 | 0.2663 | 0.3322 |
1.4543 | 0.61 | 190 | 2.1487 | 0.3022 | 0.276 | 0.344 |
1.5446 | 0.64 | 200 | 2.1496 | 0.2993 | 0.273 | 0.3418 |
1.412 | 0.67 | 210 | 2.1837 | 0.2976 | 0.268 | 0.3439 |
1.5241 | 0.7 | 220 | 2.1423 | 0.2913 | 0.2665 | 0.3305 |
1.4806 | 0.74 | 230 | 2.1303 | 0.2997 | 0.2736 | 0.3411 |
1.5405 | 0.77 | 240 | 2.1205 | 0.2966 | 0.2668 | 0.3428 |
1.4287 | 0.8 | 250 | 2.1322 | 0.2976 | 0.268 | 0.3442 |
1.4977 | 0.83 | 260 | 2.1334 | 0.2979 | 0.2665 | 0.3477 |
1.4171 | 0.86 | 270 | 2.1184 | 0.3043 | 0.2741 | 0.3509 |
1.4491 | 0.9 | 280 | 2.1038 | 0.2868 | 0.2628 | 0.3253 |
1.4316 | 0.93 | 290 | 2.1254 | 0.2958 | 0.2678 | 0.3393 |
1.4689 | 0.96 | 300 | 2.1052 | 0.299 | 0.2685 | 0.3471 |
1.4347 | 0.99 | 310 | 2.0815 | 0.3019 | 0.273 | 0.3476 |
1.3285 | 1.02 | 320 | 2.0877 | 0.2981 | 0.2695 | 0.3427 |
1.2636 | 1.06 | 330 | 2.0740 | 0.2933 | 0.2645 | 0.3382 |
1.32 | 1.09 | 340 | 2.0755 | 0.2997 | 0.2689 | 0.3487 |
1.357 | 1.12 | 350 | 2.0594 | 0.301 | 0.2743 | 0.3434 |
1.3412 | 1.15 | 360 | 2.0660 | 0.2961 | 0.2677 | 0.3405 |
1.327 | 1.18 | 370 | 2.0649 | 0.2912 | 0.263 | 0.335 |
1.3193 | 1.22 | 380 | 2.0842 | 0.2952 | 0.2673 | 0.3392 |
1.2961 | 1.25 | 390 | 2.0749 | 0.2957 | 0.2705 | 0.3342 |
1.3093 | 1.28 | 400 | 2.0715 | 0.2997 | 0.272 | 0.3441 |
1.3403 | 1.31 | 410 | 2.0671 | 0.3119 | 0.2823 | 0.3584 |
1.3685 | 1.34 | 420 | 2.0580 | 0.2973 | 0.2695 | 0.3409 |
1.2913 | 1.38 | 430 | 2.0685 | 0.2926 | 0.2632 | 0.339 |
1.3796 | 1.41 | 440 | 2.0339 | 0.2962 | 0.2697 | 0.3387 |
1.354 | 1.44 | 450 | 2.0371 | 0.2953 | 0.2665 | 0.3412 |
1.3268 | 1.47 | 460 | 2.0309 | 0.2957 | 0.2681 | 0.3395 |
1.3706 | 1.5 | 470 | 2.0215 | 0.2932 | 0.2685 | 0.3315 |
1.3288 | 1.54 | 480 | 2.0044 | 0.2948 | 0.2674 | 0.3374 |
1.4102 | 1.57 | 490 | 2.0046 | 0.2998 | 0.271 | 0.3446 |
1.3952 | 1.6 | 500 | 2.0044 | 0.3063 | 0.2794 | 0.3487 |
1.2994 | 1.63 | 510 | 1.9993 | 0.3052 | 0.2787 | 0.3461 |
1.2948 | 1.66 | 520 | 2.0168 | 0.3 | 0.2743 | 0.3406 |
1.2972 | 1.7 | 530 | 2.0290 | 0.3003 | 0.2734 | 0.342 |
1.3181 | 1.73 | 540 | 2.0234 | 0.2949 | 0.2676 | 0.338 |
1.3505 | 1.76 | 550 | 1.9942 | 0.301 | 0.2737 | 0.3436 |
1.3163 | 1.79 | 560 | 1.9983 | 0.2963 | 0.2705 | 0.3366 |
1.2876 | 1.82 | 570 | 2.0206 | 0.303 | 0.2739 | 0.3486 |
1.2895 | 1.86 | 580 | 2.0131 | 0.2958 | 0.2652 | 0.3443 |
1.3257 | 1.89 | 590 | 1.9888 | 0.3022 | 0.2743 | 0.3455 |
1.2891 | 1.92 | 600 | 1.9928 | 0.2972 | 0.2694 | 0.3408 |
1.3152 | 1.95 | 610 | 1.9785 | 0.292 | 0.2653 | 0.334 |
1.2834 | 1.98 | 620 | 2.0105 | 0.3039 | 0.2735 | 0.3511 |
1.2373 | 2.02 | 630 | 2.0023 | 0.3019 | 0.2735 | 0.346 |
1.2569 | 2.05 | 640 | 2.0006 | 0.3029 | 0.2753 | 0.3463 |
1.2337 | 2.08 | 650 | 1.9919 | 0.3006 | 0.2746 | 0.3416 |
1.1274 | 2.11 | 660 | 2.0095 | 0.3015 | 0.2732 | 0.3457 |
1.2178 | 2.14 | 670 | 1.9974 | 0.3031 | 0.275 | 0.3475 |
1.22 | 2.18 | 680 | 1.9924 | 0.3059 | 0.2777 | 0.3501 |
1.2913 | 2.21 | 690 | 1.9880 | 0.3044 | 0.2745 | 0.351 |
1.2441 | 2.24 | 700 | 1.9886 | 0.299 | 0.2721 | 0.3412 |
1.3258 | 2.27 | 710 | 1.9772 | 0.2956 | 0.2686 | 0.3377 |
1.158 | 2.3 | 720 | 2.0003 | 0.2983 | 0.2702 | 0.3424 |
1.1908 | 2.34 | 730 | 1.9845 | 0.2975 | 0.2705 | 0.3398 |
1.2411 | 2.37 | 740 | 1.9768 | 0.304 | 0.275 | 0.3493 |
1.1936 | 2.4 | 750 | 2.0065 | 0.293 | 0.2628 | 0.3403 |
1.1578 | 2.44 | 760 | 2.0199 | 0.301 | 0.2713 | 0.3473 |
1.2086 | 2.47 | 770 | 1.9949 | 0.2921 | 0.2664 | 0.3323 |
1.2574 | 2.5 | 780 | 1.9806 | 0.297 | 0.2693 | 0.3405 |
1.2331 | 2.53 | 790 | 2.0100 | 0.3012 | 0.2733 | 0.3446 |
1.2522 | 2.56 | 800 | 1.9969 | 0.301 | 0.2716 | 0.3468 |
1.2508 | 2.6 | 810 | 1.9931 | 0.3016 | 0.2719 | 0.3471 |
1.1558 | 2.63 | 820 | 1.9873 | 0.2986 | 0.2725 | 0.3402 |
1.2721 | 2.66 | 830 | 1.9763 | 0.2988 | 0.2671 | 0.348 |
1.2817 | 2.69 | 840 | 1.9713 | 0.2961 | 0.2688 | 0.3388 |
1.2183 | 2.72 | 850 | 1.9783 | 0.2985 | 0.2709 | 0.3416 |
1.2278 | 2.76 | 860 | 1.9757 | 0.2964 | 0.2681 | 0.3402 |
1.2087 | 2.79 | 870 | 1.9818 | 0.304 | 0.2735 | 0.3516 |
1.1838 | 2.82 | 880 | 1.9845 | 0.2916 | 0.2659 | 0.3312 |
1.1185 | 2.85 | 890 | 1.9912 | 0.3044 | 0.2759 | 0.3492 |
1.1214 | 2.88 | 900 | 1.9838 | 0.2995 | 0.2692 | 0.3468 |
1.2341 | 2.92 | 910 | 1.9685 | 0.296 | 0.2713 | 0.3344 |
1.1808 | 2.95 | 920 | 1.9803 | 0.3008 | 0.2725 | 0.345 |
1.2843 | 2.98 | 930 | 1.9645 | 0.3041 | 0.2745 | 0.3504 |
1.1824 | 3.01 | 940 | 1.9750 | 0.2985 | 0.2713 | 0.3412 |
1.1399 | 3.04 | 950 | 1.9762 | 0.2943 | 0.264 | 0.3416 |
1.1347 | 3.08 | 960 | 1.9841 | 0.2971 | 0.2685 | 0.3419 |
1.2298 | 3.11 | 970 | 1.9526 | 0.2993 | 0.2701 | 0.3448 |
1.1731 | 3.14 | 980 | 1.9787 | 0.304 | 0.2726 | 0.3531 |
1.1819 | 3.17 | 990 | 1.9570 | 0.2995 | 0.2715 | 0.3437 |
1.2072 | 3.2 | 1000 | 1.9613 | 0.3004 | 0.2705 | 0.3472 |
1.1214 | 3.24 | 1010 | 1.9670 | 0.3 | 0.2723 | 0.3432 |
1.226 | 3.27 | 1020 | 1.9676 | 0.2945 | 0.2639 | 0.3422 |
1.1956 | 3.3 | 1030 | 1.9721 | 0.2949 | 0.2657 | 0.3406 |
1.2286 | 3.33 | 1040 | 1.9572 | 0.3046 | 0.2759 | 0.3489 |
1.1786 | 3.36 | 1050 | 1.9549 | 0.3009 | 0.2728 | 0.3448 |
1.1512 | 3.4 | 1060 | 1.9609 | 0.2989 | 0.2699 | 0.3441 |
1.1897 | 3.43 | 1070 | 1.9626 | 0.2983 | 0.2697 | 0.3427 |
1.187 | 3.46 | 1080 | 1.9612 | 0.3016 | 0.2731 | 0.3457 |
1.1394 | 3.49 | 1090 | 1.9519 | 0.3015 | 0.2746 | 0.3431 |
1.1088 | 3.52 | 1100 | 1.9674 | 0.301 | 0.2709 | 0.3477 |
1.1787 | 3.56 | 1110 | 1.9549 | 0.3009 | 0.2728 | 0.3449 |
1.1961 | 3.59 | 1120 | 1.9545 | 0.3016 | 0.2722 | 0.3476 |
1.1194 | 3.62 | 1130 | 1.9693 | 0.3028 | 0.2735 | 0.3484 |
1.1991 | 3.65 | 1140 | 1.9538 | 0.3002 | 0.2706 | 0.3461 |
1.2109 | 3.68 | 1150 | 1.9428 | 0.3018 | 0.2729 | 0.3465 |
1.1389 | 3.72 | 1160 | 1.9578 | 0.3008 | 0.2723 | 0.3452 |
1.1922 | 3.75 | 1170 | 1.9576 | 0.2992 | 0.2701 | 0.3446 |
1.1002 | 3.78 | 1180 | 1.9571 | 0.299 | 0.2696 | 0.3445 |
1.1407 | 3.81 | 1190 | 1.9530 | 0.2979 | 0.2692 | 0.3422 |
1.1882 | 3.84 | 1200 | 1.9491 | 0.3009 | 0.2725 | 0.345 |
1.1755 | 3.88 | 1210 | 1.9562 | 0.3024 | 0.2735 | 0.3468 |
1.062 | 3.91 | 1220 | 1.9577 | 0.302 | 0.2722 | 0.3478 |
1.1965 | 3.94 | 1230 | 1.9575 | 0.3013 | 0.2716 | 0.3472 |
1.1255 | 3.97 | 1240 | 1.9550 | 0.3014 | 0.272 | 0.3466 |
Framework versions
- Transformers 4.35.2
- Pytorch 2.1.1+cu121
- Datasets 2.14.5
- Tokenizers 0.15.1
- Downloads last month
- 3
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.