ASAP_FineTuningBERT_Aug_k60_task1_organization_fold2

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5645
• Qwk: 0.4300
• Mse: 0.5645
• Rmse: 0.7513

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0022	2	11.5796	0.0	11.5796	3.4029
No log	0.0044	4	9.6592	0.0	9.6592	3.1079
No log	0.0066	6	8.8540	-0.0007	8.8540	2.9756
No log	0.0088	8	8.1988	-0.0068	8.1988	2.8634
No log	0.0110	10	7.3022	0.0	7.3022	2.7023
No log	0.0132	12	5.9535	0.0	5.9535	2.4400
No log	0.0154	14	4.6283	0.0	4.6283	2.1513
No log	0.0176	16	3.9006	0.0511	3.9006	1.9750
No log	0.0198	18	2.9838	0.0102	2.9838	1.7274
No log	0.0220	20	2.4737	0.0	2.4737	1.5728
No log	0.0242	22	1.8570	0.0	1.8570	1.3627
No log	0.0264	24	1.4374	0.0987	1.4374	1.1989
No log	0.0286	26	1.0801	0.1140	1.0801	1.0393
No log	0.0308	28	0.9874	0.0213	0.9874	0.9937
No log	0.0330	30	0.8387	0.0213	0.8387	0.9158
No log	0.0352	32	0.7664	0.0384	0.7664	0.8755
No log	0.0374	34	0.8588	0.0979	0.8588	0.9267
No log	0.0396	36	0.7961	0.0290	0.7961	0.8922
No log	0.0418	38	0.9008	0.0010	0.9008	0.9491
No log	0.0440	40	0.9100	0.0	0.9100	0.9540
No log	0.0462	42	0.8723	0.0	0.8723	0.9340
No log	0.0484	44	0.9658	0.0	0.9658	0.9827
No log	0.0505	46	0.8525	0.0	0.8525	0.9233
No log	0.0527	48	0.8317	0.1101	0.8317	0.9120
No log	0.0549	50	0.8044	-0.0019	0.8044	0.8969
No log	0.0571	52	0.9134	0.0107	0.9134	0.9557
No log	0.0593	54	1.0334	0.0213	1.0334	1.0166
No log	0.0615	56	0.9082	0.0107	0.9082	0.9530
No log	0.0637	58	0.7908	0.0	0.7908	0.8893
No log	0.0659	60	0.8489	0.2042	0.8489	0.9214
No log	0.0681	62	0.8832	0.0751	0.8832	0.9398
No log	0.0703	64	0.8986	0.0	0.8986	0.9479
No log	0.0725	66	1.0050	0.0	1.0050	1.0025
No log	0.0747	68	1.0047	0.0	1.0047	1.0024
No log	0.0769	70	0.8787	0.0	0.8787	0.9374
No log	0.0791	72	0.8405	0.0	0.8405	0.9168
No log	0.0813	74	0.8097	0.0	0.8097	0.8998
No log	0.0835	76	0.8087	0.0	0.8087	0.8993
No log	0.0857	78	0.8062	0.0	0.8062	0.8979
No log	0.0879	80	0.7896	0.0	0.7896	0.8886
No log	0.0901	82	0.7733	0.0	0.7733	0.8794
No log	0.0923	84	0.7648	0.0	0.7648	0.8745
No log	0.0945	86	0.7754	0.0107	0.7754	0.8806
No log	0.0967	88	0.7916	0.0280	0.7916	0.8897
No log	0.0989	90	0.7626	0.0218	0.7626	0.8733
No log	0.1011	92	0.7819	0.0141	0.7819	0.8842
No log	0.1033	94	0.7651	0.0129	0.7651	0.8747
No log	0.1055	96	0.7665	0.0129	0.7665	0.8755
No log	0.1077	98	0.7597	0.0218	0.7597	0.8716
No log	0.1099	100	0.7633	0.0	0.7633	0.8737
No log	0.1121	102	0.7596	0.1479	0.7596	0.8716
No log	0.1143	104	0.7649	0.1586	0.7649	0.8746
No log	0.1165	106	0.7435	0.1397	0.7435	0.8623
No log	0.1187	108	0.7318	0.1220	0.7318	0.8555
No log	0.1209	110	0.7334	0.2446	0.7334	0.8564
No log	0.1231	112	0.7493	0.2843	0.7493	0.8656
No log	0.1253	114	0.6838	0.1642	0.6838	0.8269
No log	0.1275	116	0.7418	0.0280	0.7418	0.8613
No log	0.1297	118	0.7313	0.0449	0.7313	0.8551
No log	0.1319	120	0.6662	0.0971	0.6662	0.8162
No log	0.1341	122	0.6757	0.3188	0.6757	0.8220
No log	0.1363	124	0.7391	0.3551	0.7391	0.8597
No log	0.1385	126	0.6792	0.3389	0.6792	0.8241
No log	0.1407	128	0.6624	0.1702	0.6624	0.8139
No log	0.1429	130	0.6969	0.0226	0.6969	0.8348
No log	0.1451	132	0.6716	0.1284	0.6716	0.8195
No log	0.1473	134	0.6651	0.2430	0.6651	0.8155
No log	0.1495	136	0.6587	0.2498	0.6587	0.8116
No log	0.1516	138	0.6714	0.2992	0.6714	0.8194
No log	0.1538	140	0.6470	0.2372	0.6470	0.8043
No log	0.1560	142	0.6460	0.2037	0.6460	0.8037
No log	0.1582	144	0.6545	0.3024	0.6545	0.8090
No log	0.1604	146	0.7381	0.3766	0.7381	0.8591
No log	0.1626	148	0.6909	0.3442	0.6909	0.8312
No log	0.1648	150	0.6523	0.2710	0.6523	0.8076
No log	0.1670	152	0.6461	0.2494	0.6461	0.8038
No log	0.1692	154	0.6578	0.2977	0.6578	0.8110
No log	0.1714	156	0.6940	0.3622	0.6940	0.8331
No log	0.1736	158	0.6866	0.3508	0.6866	0.8286
No log	0.1758	160	0.6473	0.3355	0.6473	0.8045
No log	0.1780	162	0.6254	0.2910	0.6254	0.7908
No log	0.1802	164	0.6070	0.2435	0.6070	0.7791
No log	0.1824	166	0.6389	0.1907	0.6389	0.7993
No log	0.1846	168	0.6073	0.2496	0.6073	0.7793
No log	0.1868	170	0.6357	0.3173	0.6357	0.7973
No log	0.1890	172	0.8621	0.2284	0.8621	0.9285
No log	0.1912	174	0.7923	0.3724	0.7923	0.8901
No log	0.1934	176	0.6551	0.2675	0.6551	0.8094
No log	0.1956	178	0.6620	0.1613	0.6620	0.8137
No log	0.1978	180	0.6535	0.1952	0.6535	0.8084
No log	0.2	182	0.6429	0.2878	0.6429	0.8018
No log	0.2022	184	0.6258	0.3233	0.6258	0.7911
No log	0.2044	186	0.6017	0.2735	0.6017	0.7757
No log	0.2066	188	0.6122	0.1902	0.6122	0.7824
No log	0.2088	190	0.5995	0.2348	0.5995	0.7743
No log	0.2110	192	0.6971	0.3051	0.6971	0.8349
No log	0.2132	194	0.7032	0.3092	0.7032	0.8385
No log	0.2154	196	0.6212	0.2357	0.6212	0.7881
No log	0.2176	198	0.7543	0.1039	0.7543	0.8685
No log	0.2198	200	0.7847	0.0798	0.7847	0.8858
No log	0.2220	202	0.6937	0.0750	0.6937	0.8329
No log	0.2242	204	0.6785	0.2977	0.6785	0.8237
No log	0.2264	206	0.7298	0.3475	0.7298	0.8543
No log	0.2286	208	0.7047	0.2741	0.7047	0.8394
No log	0.2308	210	0.7133	0.0588	0.7133	0.8446
No log	0.2330	212	0.7221	0.0299	0.7221	0.8498
No log	0.2352	214	0.6869	0.1191	0.6869	0.8288
No log	0.2374	216	0.6623	0.2749	0.6623	0.8138
No log	0.2396	218	0.6402	0.3069	0.6402	0.8001
No log	0.2418	220	0.6126	0.3056	0.6126	0.7827
No log	0.2440	222	0.6043	0.2093	0.6043	0.7774
No log	0.2462	224	0.6328	0.1480	0.6328	0.7955
No log	0.2484	226	0.6081	0.2012	0.6081	0.7798
No log	0.2505	228	0.5688	0.3190	0.5688	0.7542
No log	0.2527	230	0.5816	0.3384	0.5816	0.7626
No log	0.2549	232	0.5705	0.2909	0.5705	0.7553
No log	0.2571	234	0.5749	0.2931	0.5749	0.7582
No log	0.2593	236	0.5692	0.3108	0.5692	0.7544
No log	0.2615	238	0.6271	0.3510	0.6271	0.7919
No log	0.2637	240	0.5907	0.3264	0.5907	0.7686
No log	0.2659	242	0.5985	0.2352	0.5985	0.7736
No log	0.2681	244	0.6208	0.2076	0.6208	0.7879
No log	0.2703	246	0.5776	0.2722	0.5776	0.7600
No log	0.2725	248	0.6237	0.4042	0.6237	0.7898
No log	0.2747	250	0.6062	0.3697	0.6062	0.7786
No log	0.2769	252	0.5888	0.2601	0.5888	0.7674
No log	0.2791	254	0.5816	0.2832	0.5816	0.7626
No log	0.2813	256	0.5896	0.2381	0.5896	0.7679
No log	0.2835	258	0.5843	0.2822	0.5843	0.7644
No log	0.2857	260	0.6031	0.3680	0.6031	0.7766
No log	0.2879	262	0.6353	0.4006	0.6353	0.7970
No log	0.2901	264	0.6258	0.3659	0.6258	0.7910
No log	0.2923	266	0.6522	0.3958	0.6522	0.8076
No log	0.2945	268	0.6523	0.3695	0.6523	0.8077
No log	0.2967	270	0.6305	0.3310	0.6305	0.7940
No log	0.2989	272	0.6700	0.3900	0.6700	0.8185
No log	0.3011	274	0.7239	0.4131	0.7239	0.8508
No log	0.3033	276	0.7116	0.4385	0.7116	0.8435
No log	0.3055	278	0.6095	0.3740	0.6095	0.7807
No log	0.3077	280	0.6516	0.3837	0.6516	0.8072
No log	0.3099	282	0.8140	0.4325	0.8140	0.9022
No log	0.3121	284	0.6655	0.3713	0.6655	0.8158
No log	0.3143	286	0.6097	0.3338	0.6097	0.7808
No log	0.3165	288	0.6632	0.3439	0.6632	0.8144
No log	0.3187	290	0.8561	0.3470	0.8561	0.9253
No log	0.3209	292	0.8868	0.2977	0.8868	0.9417
No log	0.3231	294	0.6529	0.3422	0.6529	0.8080
No log	0.3253	296	0.6022	0.2669	0.6022	0.7760
No log	0.3275	298	0.6070	0.2518	0.6070	0.7791
No log	0.3297	300	0.5965	0.2983	0.5965	0.7723
No log	0.3319	302	0.7101	0.3203	0.7101	0.8427
No log	0.3341	304	0.6941	0.3957	0.6941	0.8331
No log	0.3363	306	0.6944	0.4009	0.6944	0.8333
No log	0.3385	308	0.6357	0.3864	0.6357	0.7973
No log	0.3407	310	0.6126	0.3771	0.6126	0.7827
No log	0.3429	312	0.6410	0.3746	0.6410	0.8007
No log	0.3451	314	0.7332	0.4075	0.7332	0.8563
No log	0.3473	316	0.7005	0.4243	0.7005	0.8369
No log	0.3495	318	0.5690	0.4095	0.5690	0.7543
No log	0.3516	320	0.5570	0.4124	0.5570	0.7463
No log	0.3538	322	0.6071	0.4260	0.6071	0.7792
No log	0.3560	324	0.7606	0.4127	0.7606	0.8721
No log	0.3582	326	0.8234	0.4285	0.8234	0.9074
No log	0.3604	328	0.7611	0.3943	0.7611	0.8724
No log	0.3626	330	0.6645	0.3898	0.6645	0.8152
No log	0.3648	332	0.6423	0.3710	0.6423	0.8014
No log	0.3670	334	0.6692	0.4075	0.6692	0.8180
No log	0.3692	336	0.6182	0.3917	0.6182	0.7863
No log	0.3714	338	0.5631	0.3334	0.5631	0.7504
No log	0.3736	340	0.5466	0.3661	0.5466	0.7393
No log	0.3758	342	0.5494	0.4184	0.5494	0.7412
No log	0.3780	344	0.5327	0.3931	0.5327	0.7299
No log	0.3802	346	0.6211	0.2858	0.6211	0.7881
No log	0.3824	348	0.5869	0.3020	0.5869	0.7661
No log	0.3846	350	0.5406	0.4390	0.5406	0.7353
No log	0.3868	352	0.6158	0.4566	0.6158	0.7847
No log	0.3890	354	0.5613	0.4345	0.5613	0.7492
No log	0.3912	356	0.5517	0.3588	0.5517	0.7427
No log	0.3934	358	0.5551	0.3504	0.5551	0.7450
No log	0.3956	360	0.5651	0.3605	0.5651	0.7518
No log	0.3978	362	0.5922	0.4360	0.5922	0.7696
No log	0.4	364	0.6346	0.4529	0.6346	0.7966
No log	0.4022	366	0.6209	0.4592	0.6209	0.7880
No log	0.4044	368	0.5591	0.3889	0.5591	0.7478
No log	0.4066	370	0.5476	0.3989	0.5476	0.7400
No log	0.4088	372	0.6227	0.4843	0.6227	0.7891
No log	0.4110	374	0.6289	0.4628	0.6289	0.7931
No log	0.4132	376	0.5656	0.4143	0.5656	0.7521
No log	0.4154	378	0.6327	0.4830	0.6327	0.7954
No log	0.4176	380	0.6237	0.4807	0.6237	0.7898
No log	0.4198	382	0.5507	0.4781	0.5507	0.7421
No log	0.4220	384	0.5321	0.4810	0.5321	0.7294
No log	0.4242	386	0.5104	0.4616	0.5104	0.7144
No log	0.4264	388	0.5177	0.4510	0.5177	0.7195
No log	0.4286	390	0.5717	0.4788	0.5717	0.7561
No log	0.4308	392	0.6870	0.4877	0.6870	0.8289
No log	0.4330	394	0.5953	0.4469	0.5953	0.7716
No log	0.4352	396	0.5604	0.4392	0.5604	0.7486
No log	0.4374	398	0.5257	0.3817	0.5257	0.7250
No log	0.4396	400	0.5215	0.4018	0.5215	0.7221
No log	0.4418	402	0.5464	0.4747	0.5464	0.7392
No log	0.4440	404	0.5266	0.3916	0.5266	0.7257
No log	0.4462	406	0.5601	0.2924	0.5601	0.7484
No log	0.4484	408	0.5678	0.2824	0.5678	0.7536
No log	0.4505	410	0.5223	0.3703	0.5223	0.7227
No log	0.4527	412	0.6220	0.4787	0.6220	0.7887
No log	0.4549	414	0.6535	0.4778	0.6535	0.8084
No log	0.4571	416	0.5590	0.4015	0.5590	0.7477
No log	0.4593	418	0.5617	0.2992	0.5617	0.7494
No log	0.4615	420	0.5843	0.2642	0.5843	0.7644
No log	0.4637	422	0.5511	0.3014	0.5511	0.7423
No log	0.4659	424	0.5309	0.4121	0.5309	0.7286
No log	0.4681	426	0.5883	0.4821	0.5883	0.7670
No log	0.4703	428	0.5552	0.4790	0.5552	0.7451
No log	0.4725	430	0.5089	0.4076	0.5089	0.7134
No log	0.4747	432	0.5137	0.3597	0.5137	0.7167
No log	0.4769	434	0.5252	0.4338	0.5252	0.7247
No log	0.4791	436	0.6836	0.4909	0.6836	0.8268
No log	0.4813	438	0.8803	0.4863	0.8803	0.9382
No log	0.4835	440	0.7948	0.4468	0.7948	0.8915
No log	0.4857	442	0.6713	0.4542	0.6713	0.8194
No log	0.4879	444	0.6285	0.4396	0.6285	0.7928
No log	0.4901	446	0.7271	0.5067	0.7271	0.8527
No log	0.4923	448	0.7836	0.5630	0.7836	0.8852
No log	0.4945	450	0.7189	0.5490	0.7189	0.8479
No log	0.4967	452	0.6488	0.5331	0.6488	0.8055
No log	0.4989	454	0.6227	0.5298	0.6227	0.7891
No log	0.5011	456	0.5159	0.4791	0.5159	0.7183
No log	0.5033	458	0.5478	0.5393	0.5478	0.7401
No log	0.5055	460	0.7520	0.5801	0.7520	0.8672
No log	0.5077	462	0.7573	0.5836	0.7573	0.8703
No log	0.5099	464	0.5480	0.5147	0.5480	0.7403
No log	0.5121	466	0.5023	0.4263	0.5023	0.7087
No log	0.5143	468	0.5201	0.3626	0.5201	0.7212
No log	0.5165	470	0.5055	0.4097	0.5055	0.7110
No log	0.5187	472	0.4875	0.4539	0.4875	0.6982
No log	0.5209	474	0.5274	0.5442	0.5274	0.7262
No log	0.5231	476	0.5173	0.5224	0.5173	0.7193
No log	0.5253	478	0.4927	0.4429	0.4927	0.7019
No log	0.5275	480	0.4975	0.4382	0.4975	0.7054
No log	0.5297	482	0.5551	0.4682	0.5551	0.7450
No log	0.5319	484	0.7111	0.5402	0.7111	0.8433
No log	0.5341	486	0.6352	0.4390	0.6352	0.7970
No log	0.5363	488	0.6087	0.4156	0.6087	0.7802
No log	0.5385	490	0.7193	0.4799	0.7193	0.8481
No log	0.5407	492	0.7021	0.5042	0.7021	0.8379
No log	0.5429	494	0.5671	0.3958	0.5671	0.7531
No log	0.5451	496	0.5681	0.3314	0.5681	0.7537
No log	0.5473	498	0.5537	0.3586	0.5537	0.7441
0.56	0.5495	500	0.5509	0.4641	0.5509	0.7422
0.56	0.5516	502	0.5615	0.4737	0.5615	0.7493
0.56	0.5538	504	0.5239	0.4119	0.5239	0.7238
0.56	0.5560	506	0.5366	0.3761	0.5366	0.7326
0.56	0.5582	508	0.5469	0.4422	0.5469	0.7395
0.56	0.5604	510	0.5897	0.4557	0.5897	0.7679
0.56	0.5626	512	0.5645	0.4300	0.5645	0.7513

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1