ASAP_FineTuningBERT_AugV7_k7_task1_organization_fold2

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8391
• Qwk: 0.3375
• Mse: 0.8392
• Rmse: 0.9161

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 64
• eval_batch_size: 64
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.3333	2	10.7007	0.0100	10.7005	3.2712
No log	0.6667	4	8.6536	0.0	8.6527	2.9416
No log	1.0	6	6.7715	0.0	6.7714	2.6022
No log	1.3333	8	5.1434	0.0232	5.1434	2.2679
5.9288	1.6667	10	3.8205	0.0078	3.8203	1.9546
5.9288	2.0	12	2.9550	0.0078	2.9550	1.7190
5.9288	2.3333	14	2.2956	0.1229	2.2958	1.5152
5.9288	2.6667	16	1.7948	0.0307	1.7948	1.3397
5.9288	3.0	18	1.3340	0.0213	1.3342	1.1551
2.0963	3.3333	20	1.1982	0.0280	1.1984	1.0947
2.0963	3.6667	22	1.2576	0.0280	1.2576	1.1214
2.0963	4.0	24	0.9936	0.0420	0.9937	0.9969
2.0963	4.3333	26	1.2300	0.0479	1.2300	1.1090
2.0963	4.6667	28	0.7945	0.3505	0.7947	0.8915
1.738	5.0	30	0.7574	0.3803	0.7577	0.8704
1.738	5.3333	32	0.8803	0.2562	0.8804	0.9383
1.738	5.6667	34	1.7538	0.1246	1.7537	1.3243
1.738	6.0	36	1.0740	0.2022	1.0741	1.0364
1.738	6.3333	38	0.7430	0.4018	0.7433	0.8621
1.6233	6.6667	40	0.8007	0.3097	0.8009	0.8949
1.6233	7.0	42	1.6081	0.0985	1.6081	1.2681
1.6233	7.3333	44	1.0661	0.1991	1.0662	1.0326
1.6233	7.6667	46	0.6917	0.3879	0.6919	0.8318
1.6233	8.0	48	0.6921	0.4305	0.6922	0.8320
1.2249	8.3333	50	1.2513	0.2624	1.2513	1.1186
1.2249	8.6667	52	0.8437	0.4019	0.8437	0.9185
1.2249	9.0	54	0.6897	0.3190	0.6897	0.8305
1.2249	9.3333	56	0.9997	0.2508	0.9997	0.9998
1.2249	9.6667	58	0.8863	0.2658	0.8862	0.9414
0.7703	10.0	60	0.7000	0.3748	0.6999	0.8366
0.7703	10.3333	62	1.2659	0.2723	1.2659	1.1251
0.7703	10.6667	64	0.9304	0.3474	0.9305	0.9646
0.7703	11.0	66	1.1070	0.3191	1.1071	1.0522
0.7703	11.3333	68	1.2022	0.2973	1.2023	1.0965
0.4495	11.6667	70	0.8431	0.3897	0.8433	0.9183
0.4495	12.0	72	1.1536	0.2762	1.1538	1.0741
0.4495	12.3333	74	1.1933	0.2514	1.1935	1.0925
0.4495	12.6667	76	0.9443	0.3074	0.9445	0.9719
0.4495	13.0	78	1.3391	0.2136	1.3393	1.1573
0.2736	13.3333	80	0.9381	0.3237	0.9384	0.9687
0.2736	13.6667	82	1.1110	0.2817	1.1112	1.0541
0.2736	14.0	84	1.1011	0.2972	1.1013	1.0494
0.2736	14.3333	86	1.0656	0.3290	1.0658	1.0324
0.2736	14.6667	88	1.6478	0.1921	1.6478	1.2837
0.2245	15.0	90	0.9721	0.3648	0.9724	0.9861
0.2245	15.3333	92	1.1168	0.3214	1.1170	1.0569
0.2245	15.6667	94	1.9056	0.1576	1.9056	1.3804
0.2245	16.0	96	1.0668	0.3257	1.0670	1.0330
0.2245	16.3333	98	0.8969	0.4063	0.8971	0.9472
0.2309	16.6667	100	1.6668	0.1892	1.6669	1.2911
0.2309	17.0	102	1.6052	0.2106	1.6052	1.2670
0.2309	17.3333	104	0.7918	0.3994	0.7921	0.8900
0.2309	17.6667	106	0.8010	0.4299	0.8013	0.8952
0.2309	18.0	108	1.1928	0.2592	1.1929	1.0922
0.2968	18.3333	110	1.4791	0.2079	1.4792	1.2162
0.2968	18.6667	112	0.7949	0.4127	0.7951	0.8917
0.2968	19.0	114	0.7795	0.4047	0.7798	0.8831
0.2968	19.3333	116	1.4272	0.2012	1.4273	1.1947
0.2968	19.6667	118	1.6484	0.1526	1.6484	1.2839
0.2394	20.0	120	0.8373	0.3547	0.8376	0.9152
0.2394	20.3333	122	0.7611	0.4054	0.7613	0.8725
0.2394	20.6667	124	1.2280	0.2716	1.2279	1.1081
0.2394	21.0	126	1.3792	0.2455	1.3791	1.1744
0.2394	21.3333	128	0.7666	0.4417	0.7668	0.8756
0.191	21.6667	130	0.7451	0.4558	0.7452	0.8633
0.191	22.0	132	1.1651	0.2956	1.1651	1.0794
0.191	22.3333	134	1.3125	0.2528	1.3124	1.1456
0.191	22.6667	136	0.7533	0.4176	0.7534	0.8680
0.191	23.0	138	0.7239	0.4272	0.7242	0.8510
0.1806	23.3333	140	1.0813	0.2876	1.0813	1.0399
0.1806	23.6667	142	1.1702	0.2440	1.1702	1.0818
0.1806	24.0	144	0.8646	0.3618	0.8647	0.9299
0.1806	24.3333	146	1.0358	0.3158	1.0359	1.0178
0.1806	24.6667	148	0.8722	0.3869	0.8723	0.9340
0.1269	25.0	150	1.0125	0.3136	1.0126	1.0063
0.1269	25.3333	152	0.8518	0.3711	0.8520	0.9230
0.1269	25.6667	154	0.8717	0.3427	0.8718	0.9337
0.1269	26.0	156	0.8907	0.3224	0.8908	0.9438
0.1269	26.3333	158	0.7276	0.4024	0.7277	0.8531
0.1134	26.6667	160	0.7971	0.3755	0.7971	0.8928
0.1134	27.0	162	1.0038	0.3225	1.0037	1.0018
0.1134	27.3333	164	0.7457	0.4431	0.7458	0.8636
0.1134	27.6667	166	0.7692	0.4131	0.7693	0.8771
0.1134	28.0	168	1.0300	0.2720	1.0299	1.0148
0.1421	28.3333	170	0.8548	0.3452	0.8548	0.9246
0.1421	28.6667	172	0.9143	0.2808	0.9143	0.9562
0.1421	29.0	174	0.8677	0.2672	0.8678	0.9315
0.1421	29.3333	176	0.9738	0.2417	0.9738	0.9868
0.1421	29.6667	178	0.9806	0.2795	0.9806	0.9903
0.1031	30.0	180	1.1889	0.2391	1.1888	1.0903
0.1031	30.3333	182	1.0167	0.2693	1.0167	1.0083
0.1031	30.6667	184	0.9568	0.3023	0.9568	0.9781
0.1031	31.0	186	0.9205	0.3221	0.9205	0.9594
0.1031	31.3333	188	0.9522	0.3379	0.9522	0.9758
0.0885	31.6667	190	0.9022	0.3361	0.9022	0.9499
0.0885	32.0	192	1.1004	0.2534	1.1005	1.0490
0.0885	32.3333	194	0.8312	0.2853	0.8313	0.9118
0.0885	32.6667	196	0.8367	0.2650	0.8368	0.9148
0.0885	33.0	198	1.0221	0.2016	1.0221	1.0110
0.1067	33.3333	200	0.7837	0.2924	0.7838	0.8853
0.1067	33.6667	202	0.7575	0.3402	0.7576	0.8704
0.1067	34.0	204	1.1798	0.2395	1.1798	1.0862
0.1067	34.3333	206	1.2620	0.2761	1.2621	1.1234
0.1067	34.6667	208	0.7696	0.4460	0.7697	0.8773
0.1201	35.0	210	0.7151	0.4768	0.7152	0.8457
0.1201	35.3333	212	1.1236	0.3498	1.1237	1.0600
0.1201	35.6667	214	1.2382	0.3169	1.2382	1.1127
0.1201	36.0	216	0.7813	0.4333	0.7814	0.8840
0.1201	36.3333	218	0.7432	0.4470	0.7434	0.8622
0.1027	36.6667	220	1.1085	0.2712	1.1086	1.0529
0.1027	37.0	222	1.1829	0.2389	1.1829	1.0876
0.1027	37.3333	224	0.7803	0.3620	0.7804	0.8834
0.1027	37.6667	226	0.7345	0.3718	0.7347	0.8571
0.1027	38.0	228	0.8145	0.3244	0.8146	0.9026
0.0943	38.3333	230	1.0542	0.2243	1.0542	1.0267
0.0943	38.6667	232	1.0085	0.2485	1.0085	1.0043
0.0943	39.0	234	0.7495	0.3597	0.7496	0.8658
0.0943	39.3333	236	0.8190	0.3365	0.8190	0.9050
0.0943	39.6667	238	0.9975	0.2692	0.9975	0.9988
0.086	40.0	240	0.9547	0.3198	0.9547	0.9771
0.086	40.3333	242	0.9182	0.3622	0.9182	0.9582
0.086	40.6667	244	0.7829	0.4499	0.7830	0.8848
0.086	41.0	246	0.9207	0.3572	0.9207	0.9595
0.086	41.3333	248	0.7749	0.4407	0.7750	0.8803
0.0779	41.6667	250	0.7853	0.3864	0.7853	0.8862
0.0779	42.0	252	0.8843	0.3167	0.8843	0.9404
0.0779	42.3333	254	0.7992	0.3136	0.7993	0.8940
0.0779	42.6667	256	0.7971	0.2988	0.7972	0.8928
0.0779	43.0	258	0.9306	0.2637	0.9306	0.9647
0.0794	43.3333	260	0.8480	0.2911	0.8481	0.9209
0.0794	43.6667	262	0.6942	0.3775	0.6943	0.8332
0.0794	44.0	264	0.7819	0.3663	0.7819	0.8843
0.0794	44.3333	266	0.9753	0.3125	0.9753	0.9876
0.0794	44.6667	268	0.7980	0.3953	0.7981	0.8933
0.0851	45.0	270	0.8380	0.3514	0.8381	0.9155
0.0851	45.3333	272	0.8849	0.3345	0.8849	0.9407
0.0851	45.6667	274	0.7722	0.3849	0.7723	0.8788
0.0851	46.0	276	0.9506	0.3133	0.9506	0.9750
0.0851	46.3333	278	0.9178	0.3320	0.9178	0.9580
0.0654	46.6667	280	0.7451	0.3843	0.7452	0.8633
0.0654	47.0	282	0.8753	0.3373	0.8754	0.9356
0.0654	47.3333	284	0.9998	0.2861	0.9998	0.9999
0.0654	47.6667	286	0.7795	0.3851	0.7796	0.8829
0.0654	48.0	288	0.6548	0.4173	0.6550	0.8093
0.0784	48.3333	290	0.7152	0.4125	0.7153	0.8457
0.0784	48.6667	292	0.9528	0.3221	0.9529	0.9761
0.0784	49.0	294	0.8432	0.3437	0.8433	0.9183
0.0784	49.3333	296	0.7793	0.3903	0.7794	0.8828
0.0784	49.6667	298	0.8890	0.3470	0.8891	0.9429
0.0585	50.0	300	0.7757	0.3735	0.7758	0.8808
0.0585	50.3333	302	0.7029	0.3904	0.7030	0.8385
0.0585	50.6667	304	0.7992	0.3051	0.7993	0.8941
0.0585	51.0	306	0.7945	0.2949	0.7947	0.8915
0.0585	51.3333	308	0.7477	0.3359	0.7479	0.8648
0.058	51.6667	310	0.7567	0.3280	0.7569	0.8700
0.058	52.0	312	0.8296	0.2949	0.8297	0.9109
0.058	52.3333	314	0.7544	0.3543	0.7545	0.8686
0.058	52.6667	316	0.6866	0.4392	0.6868	0.8287
0.058	53.0	318	0.7124	0.4139	0.7126	0.8441
0.0633	53.3333	320	0.7490	0.4439	0.7491	0.8655
0.0633	53.6667	322	0.6921	0.4365	0.6922	0.8320
0.0633	54.0	324	0.7217	0.4281	0.7218	0.8496
0.0633	54.3333	326	0.8134	0.3772	0.8135	0.9020
0.0633	54.6667	328	0.8304	0.3444	0.8305	0.9113
0.0615	55.0	330	0.7596	0.3865	0.7597	0.8716
0.0615	55.3333	332	0.8017	0.3395	0.8018	0.8954
0.0615	55.6667	334	0.9189	0.2789	0.9189	0.9586
0.0615	56.0	336	0.8127	0.3172	0.8127	0.9015
0.0615	56.3333	338	0.7487	0.3401	0.7488	0.8654
0.0674	56.6667	340	0.8987	0.2929	0.8988	0.9480
0.0674	57.0	342	0.8980	0.3179	0.8981	0.9477
0.0674	57.3333	344	0.8446	0.3391	0.8447	0.9191
0.0674	57.6667	346	0.8810	0.3113	0.8810	0.9386
0.0674	58.0	348	0.7725	0.3544	0.7725	0.8789
0.0527	58.3333	350	0.7700	0.3518	0.7701	0.8775
0.0527	58.6667	352	0.9095	0.2972	0.9095	0.9537
0.0527	59.0	354	0.8873	0.3113	0.8873	0.9420
0.0527	59.3333	356	0.7372	0.3652	0.7373	0.8587
0.0527	59.6667	358	0.7216	0.3587	0.7218	0.8496
0.0613	60.0	360	0.8379	0.3014	0.8380	0.9154
0.0613	60.3333	362	0.8372	0.2958	0.8373	0.9151
0.0613	60.6667	364	0.7554	0.3428	0.7555	0.8692
0.0613	61.0	366	0.8271	0.2971	0.8272	0.9095
0.0613	61.3333	368	0.9061	0.2940	0.9062	0.9519
0.0548	61.6667	370	0.7862	0.3108	0.7863	0.8867
0.0548	62.0	372	0.7505	0.3473	0.7507	0.8664
0.0548	62.3333	374	0.8591	0.2837	0.8592	0.9269
0.0548	62.6667	376	0.8756	0.2904	0.8757	0.9358
0.0548	63.0	378	0.7380	0.3347	0.7381	0.8591
0.0524	63.3333	380	0.7193	0.3508	0.7195	0.8482
0.0524	63.6667	382	0.8345	0.3256	0.8347	0.9136
0.0524	64.0	384	0.9135	0.3103	0.9136	0.9558
0.0524	64.3333	386	0.8223	0.3728	0.8223	0.9068
0.0524	64.6667	388	0.7120	0.4036	0.7121	0.8439
0.0538	65.0	390	0.7618	0.4077	0.7619	0.8729
0.0538	65.3333	392	0.8507	0.3485	0.8507	0.9223
0.0538	65.6667	394	0.7720	0.4057	0.7721	0.8787
0.0538	66.0	396	0.6956	0.3984	0.6957	0.8341
0.0538	66.3333	398	0.7526	0.3730	0.7526	0.8675
0.0419	66.6667	400	0.8464	0.3121	0.8465	0.9200
0.0419	67.0	402	0.7851	0.3427	0.7851	0.8861
0.0419	67.3333	404	0.7682	0.3608	0.7683	0.8765
0.0419	67.6667	406	0.8808	0.3112	0.8809	0.9385
0.0419	68.0	408	0.8903	0.3115	0.8903	0.9436
0.0501	68.3333	410	0.7604	0.3789	0.7604	0.8720
0.0501	68.6667	412	0.6690	0.4125	0.6691	0.8180
0.0501	69.0	414	0.6919	0.4070	0.6920	0.8319
0.0501	69.3333	416	0.8573	0.3217	0.8573	0.9259
0.0501	69.6667	418	0.9556	0.3099	0.9556	0.9775
0.0565	70.0	420	0.8532	0.3385	0.8532	0.9237
0.0565	70.3333	422	0.7190	0.3833	0.7190	0.8480
0.0565	70.6667	424	0.7284	0.3886	0.7285	0.8535
0.0565	71.0	426	0.8159	0.3589	0.8159	0.9033
0.0565	71.3333	428	0.9219	0.2897	0.9219	0.9602
0.0463	71.6667	430	0.8592	0.2962	0.8592	0.9270
0.0463	72.0	432	0.7202	0.3493	0.7202	0.8487
0.0463	72.3333	434	0.6958	0.3412	0.6959	0.8342
0.0463	72.6667	436	0.7385	0.3303	0.7386	0.8594
0.0463	73.0	438	0.8415	0.3005	0.8415	0.9174
0.056	73.3333	440	0.8442	0.3006	0.8443	0.9188
0.056	73.6667	442	0.7761	0.3441	0.7762	0.8810
0.056	74.0	444	0.7791	0.3591	0.7791	0.8827
0.056	74.3333	446	0.8966	0.3037	0.8966	0.9469
0.056	74.6667	448	0.9506	0.3028	0.9507	0.9750
0.0473	75.0	450	0.8602	0.3385	0.8602	0.9275
0.0473	75.3333	452	0.7405	0.3699	0.7406	0.8606
0.0473	75.6667	454	0.7326	0.3864	0.7326	0.8559
0.0473	76.0	456	0.8267	0.3542	0.8267	0.9093
0.0473	76.3333	458	0.9725	0.2886	0.9724	0.9861
0.051	76.6667	460	0.9514	0.3032	0.9514	0.9754
0.051	77.0	462	0.8472	0.3427	0.8472	0.9204
0.051	77.3333	464	0.7898	0.3729	0.7898	0.8887
0.051	77.6667	466	0.8274	0.3336	0.8274	0.9096
0.051	78.0	468	0.8206	0.3309	0.8206	0.9059
0.0513	78.3333	470	0.8288	0.3295	0.8289	0.9104
0.0513	78.6667	472	0.8704	0.3152	0.8705	0.9330
0.0513	79.0	474	0.8860	0.3022	0.8860	0.9413
0.0513	79.3333	476	0.8572	0.3243	0.8573	0.9259
0.0513	79.6667	478	0.8167	0.3363	0.8167	0.9037
0.0454	80.0	480	0.8268	0.3363	0.8269	0.9093
0.0454	80.3333	482	0.8501	0.3151	0.8501	0.9220
0.0454	80.6667	484	0.7961	0.3511	0.7962	0.8923
0.0454	81.0	486	0.7265	0.3973	0.7266	0.8524
0.0454	81.3333	488	0.7365	0.3904	0.7365	0.8582
0.0411	81.6667	490	0.8079	0.3324	0.8079	0.8989
0.0411	82.0	492	0.8340	0.3323	0.8341	0.9133
0.0411	82.3333	494	0.7920	0.3543	0.7921	0.8900
0.0411	82.6667	496	0.7393	0.3750	0.7394	0.8599
0.0411	83.0	498	0.7508	0.3706	0.7509	0.8665
0.0481	83.3333	500	0.7798	0.3550	0.7798	0.8831
0.0481	83.6667	502	0.7890	0.3369	0.7890	0.8883
0.0481	84.0	504	0.7598	0.3569	0.7599	0.8717
0.0481	84.3333	506	0.7609	0.3567	0.7610	0.8723
0.0481	84.6667	508	0.7436	0.3720	0.7437	0.8624
0.0472	85.0	510	0.7539	0.3639	0.7540	0.8683
0.0472	85.3333	512	0.7617	0.3718	0.7617	0.8728
0.0472	85.6667	514	0.7951	0.3747	0.7951	0.8917
0.0472	86.0	516	0.8176	0.3637	0.8177	0.9043
0.0472	86.3333	518	0.7974	0.3602	0.7974	0.8930
0.0364	86.6667	520	0.7870	0.3710	0.7870	0.8871
0.0364	87.0	522	0.8192	0.3521	0.8192	0.9051
0.0364	87.3333	524	0.8714	0.3062	0.8714	0.9335
0.0364	87.6667	526	0.8572	0.3153	0.8572	0.9259
0.0364	88.0	528	0.8668	0.3140	0.8668	0.9310
0.042	88.3333	530	0.8391	0.3375	0.8392	0.9161

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.1+cu121
• Datasets 3.2.0
• Tokenizers 0.19.1