ASAP_FineTuningBERT_Aug_k25_task1_organization_fold1

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5742
• Qwk: 0.5276
• Mse: 0.5742
• Rmse: 0.7578

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0049	2	10.1128	0.0	10.1128	3.1801
No log	0.0098	4	8.9943	0.0	8.9943	2.9990
No log	0.0147	6	7.7995	0.0324	7.7995	2.7928
No log	0.0197	8	6.5605	0.0016	6.5605	2.5614
No log	0.0246	10	5.2675	0.0	5.2675	2.2951
No log	0.0295	12	4.1268	0.0093	4.1268	2.0315
No log	0.0344	14	2.9789	0.0303	2.9789	1.7259
No log	0.0393	16	2.1328	0.0040	2.1328	1.4604
No log	0.0442	18	1.6251	0.0	1.6251	1.2748
No log	0.0491	20	1.2514	0.2066	1.2514	1.1186
No log	0.0541	22	1.0487	0.0768	1.0487	1.0241
No log	0.0590	24	0.9011	0.0211	0.9011	0.9492
No log	0.0639	26	0.8605	0.0106	0.8605	0.9276
No log	0.0688	28	0.8888	0.0211	0.8888	0.9427
No log	0.0737	30	0.8545	0.0	0.8545	0.9244
No log	0.0786	32	0.8596	0.0	0.8596	0.9271
No log	0.0835	34	0.8934	0.0782	0.8934	0.9452
No log	0.0885	36	0.8689	0.0171	0.8689	0.9322
No log	0.0934	38	0.9398	0.0	0.9398	0.9694
No log	0.0983	40	0.9685	0.0	0.9685	0.9841
No log	0.1032	42	0.8812	0.0	0.8812	0.9387
No log	0.1081	44	0.9606	0.0	0.9606	0.9801
No log	0.1130	46	0.9836	0.0	0.9836	0.9918
No log	0.1179	48	0.9136	0.0	0.9136	0.9558
No log	0.1229	50	0.8807	0.0	0.8807	0.9385
No log	0.1278	52	0.9246	0.0	0.9246	0.9616
No log	0.1327	54	0.9487	0.0106	0.9487	0.9740
No log	0.1376	56	0.9474	0.0326	0.9474	0.9733
No log	0.1425	58	0.8869	0.0172	0.8869	0.9418
No log	0.1474	60	0.8318	0.0	0.8318	0.9120
No log	0.1523	62	0.8245	0.0	0.8245	0.9080
No log	0.1572	64	0.8219	0.0	0.8219	0.9066
No log	0.1622	66	0.8613	0.0	0.8613	0.9281
No log	0.1671	68	0.8330	0.0	0.8330	0.9127
No log	0.1720	70	0.8057	0.0067	0.8057	0.8976
No log	0.1769	72	0.7668	0.0390	0.7668	0.8757
No log	0.1818	74	0.7325	0.0276	0.7325	0.8558
No log	0.1867	76	0.7240	0.0443	0.7240	0.8509
No log	0.1916	78	0.7276	0.0645	0.7276	0.8530
No log	0.1966	80	0.7571	0.0752	0.7571	0.8701
No log	0.2015	82	0.7769	0.0752	0.7769	0.8814
No log	0.2064	84	0.7690	0.0645	0.7690	0.8769
No log	0.2113	86	0.7435	0.0583	0.7435	0.8623
No log	0.2162	88	0.7259	0.0276	0.7259	0.8520
No log	0.2211	90	0.7201	0.0379	0.7201	0.8486
No log	0.2260	92	0.7152	0.0482	0.7152	0.8457
No log	0.2310	94	0.7174	0.0482	0.7174	0.8470
No log	0.2359	96	0.7270	0.0470	0.7270	0.8526
No log	0.2408	98	0.7385	0.2595	0.7385	0.8593
No log	0.2457	100	0.7141	0.1470	0.7141	0.8450
No log	0.2506	102	0.7350	0.1244	0.7350	0.8573
No log	0.2555	104	0.7392	0.1205	0.7392	0.8598
No log	0.2604	106	0.7598	0.0568	0.7598	0.8716
No log	0.2654	108	0.8377	0.0444	0.8377	0.9153
No log	0.2703	110	0.8516	0.0418	0.8516	0.9228
No log	0.2752	112	0.8401	0.0431	0.8401	0.9166
No log	0.2801	114	0.8037	0.0520	0.8037	0.8965
No log	0.2850	116	0.7879	0.0728	0.7879	0.8877
No log	0.2899	118	0.7801	0.1424	0.7801	0.8832
No log	0.2948	120	0.7344	0.1201	0.7344	0.8570
No log	0.2998	122	0.6831	0.1459	0.6831	0.8265
No log	0.3047	124	0.6612	0.1889	0.6612	0.8131
No log	0.3096	126	0.6524	0.3548	0.6524	0.8077
No log	0.3145	128	0.6201	0.4054	0.6201	0.7874
No log	0.3194	130	0.5923	0.3200	0.5923	0.7696
No log	0.3243	132	0.6082	0.2435	0.6082	0.7799
No log	0.3292	134	0.6437	0.1258	0.6437	0.8023
No log	0.3342	136	0.6357	0.1563	0.6357	0.7973
No log	0.3391	138	0.6285	0.4111	0.6285	0.7928
No log	0.3440	140	0.7422	0.4357	0.7422	0.8615
No log	0.3489	142	0.7150	0.4322	0.7150	0.8456
No log	0.3538	144	0.6028	0.4091	0.6028	0.7764
No log	0.3587	146	0.6015	0.4225	0.6015	0.7756
No log	0.3636	148	0.6951	0.4823	0.6951	0.8337
No log	0.3686	150	0.7038	0.4990	0.7038	0.8389
No log	0.3735	152	0.5787	0.4695	0.5787	0.7607
No log	0.3784	154	0.6215	0.3352	0.6215	0.7884
No log	0.3833	156	0.6272	0.3477	0.6272	0.7919
No log	0.3882	158	0.5507	0.4780	0.5507	0.7421
No log	0.3931	160	0.5994	0.4818	0.5994	0.7742
No log	0.3980	162	0.5815	0.4971	0.5815	0.7626
No log	0.4029	164	0.5675	0.3627	0.5675	0.7533
No log	0.4079	166	0.5865	0.2939	0.5865	0.7659
No log	0.4128	168	0.5698	0.3939	0.5698	0.7548
No log	0.4177	170	0.6356	0.4899	0.6356	0.7973
No log	0.4226	172	0.6942	0.4900	0.6942	0.8332
No log	0.4275	174	0.6633	0.4815	0.6633	0.8144
No log	0.4324	176	0.5872	0.4197	0.5872	0.7663
No log	0.4373	178	0.6004	0.2276	0.6004	0.7748
No log	0.4423	180	0.6033	0.2297	0.6033	0.7767
No log	0.4472	182	0.5766	0.3970	0.5766	0.7593
No log	0.4521	184	0.6689	0.4717	0.6689	0.8178
No log	0.4570	186	0.7695	0.4042	0.7695	0.8772
No log	0.4619	188	0.7469	0.4181	0.7469	0.8642
No log	0.4668	190	0.6979	0.3625	0.6979	0.8354
No log	0.4717	192	0.7124	0.2142	0.7124	0.8441
No log	0.4767	194	0.7172	0.3972	0.7172	0.8469
No log	0.4816	196	0.7136	0.4752	0.7136	0.8447
No log	0.4865	198	0.7077	0.4783	0.7077	0.8413
No log	0.4914	200	0.7011	0.4889	0.7011	0.8373
No log	0.4963	202	0.6820	0.4918	0.6820	0.8258
No log	0.5012	204	0.6660	0.5004	0.6660	0.8161
No log	0.5061	206	0.6313	0.5193	0.6313	0.7945
No log	0.5111	208	0.6562	0.5317	0.6562	0.8101
No log	0.5160	210	0.5680	0.5665	0.5680	0.7537
No log	0.5209	212	0.5510	0.5565	0.5510	0.7423
No log	0.5258	214	0.5106	0.5486	0.5106	0.7146
No log	0.5307	216	0.5433	0.5795	0.5433	0.7371
No log	0.5356	218	0.4979	0.5820	0.4979	0.7056
No log	0.5405	220	0.4783	0.5050	0.4783	0.6916
No log	0.5455	222	0.4630	0.5287	0.4630	0.6805
No log	0.5504	224	0.4581	0.5551	0.4581	0.6768
No log	0.5553	226	0.5263	0.5927	0.5263	0.7255
No log	0.5602	228	0.7635	0.4351	0.7635	0.8738
No log	0.5651	230	1.0279	0.2025	1.0279	1.0138
No log	0.5700	232	1.0434	0.2820	1.0434	1.0215
No log	0.5749	234	0.8612	0.3846	0.8612	0.9280
No log	0.5799	236	0.7987	0.4225	0.7987	0.8937
No log	0.5848	238	0.8258	0.4022	0.8258	0.9087
No log	0.5897	240	0.7656	0.4263	0.7656	0.8750
No log	0.5946	242	0.7307	0.4419	0.7307	0.8548
No log	0.5995	244	0.7634	0.4449	0.7634	0.8737
No log	0.6044	246	0.6035	0.4980	0.6035	0.7769
No log	0.6093	248	0.5288	0.4402	0.5288	0.7272
No log	0.6143	250	0.5195	0.4752	0.5195	0.7207
No log	0.6192	252	0.5899	0.5062	0.5899	0.7681
No log	0.6241	254	0.6204	0.5011	0.6204	0.7877
No log	0.6290	256	0.7014	0.4740	0.7014	0.8375
No log	0.6339	258	0.6151	0.4904	0.6151	0.7843
No log	0.6388	260	0.5681	0.4732	0.5681	0.7537
No log	0.6437	262	0.5711	0.3029	0.5711	0.7557
No log	0.6486	264	0.5710	0.3919	0.5710	0.7557
No log	0.6536	266	0.5865	0.4336	0.5865	0.7658
No log	0.6585	268	0.5858	0.4150	0.5858	0.7654
No log	0.6634	270	0.5771	0.2926	0.5771	0.7597
No log	0.6683	272	0.5823	0.2582	0.5823	0.7631
No log	0.6732	274	0.5503	0.4403	0.5503	0.7418
No log	0.6781	276	0.6317	0.5141	0.6317	0.7948
No log	0.6830	278	0.6959	0.4922	0.6959	0.8342
No log	0.6880	280	0.6101	0.5248	0.6101	0.7811
No log	0.6929	282	0.5580	0.4842	0.5580	0.7470
No log	0.6978	284	0.5688	0.4833	0.5688	0.7542
No log	0.7027	286	0.6073	0.5096	0.6073	0.7793
No log	0.7076	288	0.6491	0.5226	0.6491	0.8057
No log	0.7125	290	0.6436	0.5091	0.6436	0.8023
No log	0.7174	292	0.6434	0.5084	0.6434	0.8021
No log	0.7224	294	0.5828	0.4337	0.5828	0.7634
No log	0.7273	296	0.5625	0.3556	0.5625	0.7500
No log	0.7322	298	0.5582	0.3241	0.5582	0.7471
No log	0.7371	300	0.5544	0.4767	0.5544	0.7446
No log	0.7420	302	0.6449	0.5024	0.6449	0.8031
No log	0.7469	304	0.6234	0.5138	0.6234	0.7896
No log	0.7518	306	0.5243	0.5019	0.5243	0.7241
No log	0.7568	308	0.5382	0.3475	0.5382	0.7336
No log	0.7617	310	0.5320	0.3510	0.5320	0.7294
No log	0.7666	312	0.4957	0.4885	0.4957	0.7040
No log	0.7715	314	0.5830	0.5293	0.5830	0.7635
No log	0.7764	316	0.5886	0.5480	0.5886	0.7672
No log	0.7813	318	0.4838	0.5468	0.4838	0.6956
No log	0.7862	320	0.4668	0.5205	0.4668	0.6832
No log	0.7912	322	0.4647	0.4996	0.4647	0.6817
No log	0.7961	324	0.4582	0.5328	0.4582	0.6769
No log	0.8010	326	0.4574	0.5561	0.4574	0.6763
No log	0.8059	328	0.4591	0.5546	0.4591	0.6775
No log	0.8108	330	0.4420	0.5515	0.4420	0.6648
No log	0.8157	332	0.4386	0.5533	0.4386	0.6623
No log	0.8206	334	0.4409	0.5459	0.4409	0.6640
No log	0.8256	336	0.4340	0.5524	0.4340	0.6588
No log	0.8305	338	0.4475	0.5581	0.4475	0.6689
No log	0.8354	340	0.4293	0.5655	0.4293	0.6552
No log	0.8403	342	0.4330	0.5695	0.4330	0.6580
No log	0.8452	344	0.4234	0.5587	0.4234	0.6507
No log	0.8501	346	0.4824	0.5736	0.4824	0.6945
No log	0.8550	348	0.5140	0.5911	0.5140	0.7169
No log	0.8600	350	0.4262	0.5602	0.4262	0.6529
No log	0.8649	352	0.4381	0.5275	0.4381	0.6619
No log	0.8698	354	0.4407	0.5713	0.4407	0.6639
No log	0.8747	356	0.6305	0.5876	0.6305	0.7940
No log	0.8796	358	0.7397	0.5399	0.7397	0.8601
No log	0.8845	360	0.5972	0.5745	0.5972	0.7728
No log	0.8894	362	0.4624	0.5444	0.4624	0.6800
No log	0.8943	364	0.4427	0.5714	0.4427	0.6654
No log	0.8993	366	0.4513	0.5967	0.4513	0.6718
No log	0.9042	368	0.5772	0.5873	0.5772	0.7597
No log	0.9091	370	0.6064	0.6086	0.6064	0.7787
No log	0.9140	372	0.4612	0.6155	0.4612	0.6791
No log	0.9189	374	0.4125	0.5595	0.4125	0.6423
No log	0.9238	376	0.4153	0.5622	0.4153	0.6445
No log	0.9287	378	0.4368	0.5968	0.4368	0.6609
No log	0.9337	380	0.4642	0.6211	0.4642	0.6813
No log	0.9386	382	0.4825	0.6245	0.4825	0.6946
No log	0.9435	384	0.4562	0.6044	0.4562	0.6755
No log	0.9484	386	0.4663	0.6003	0.4663	0.6828
No log	0.9533	388	0.5363	0.6060	0.5363	0.7323
No log	0.9582	390	0.7487	0.5385	0.7487	0.8653
No log	0.9631	392	0.7755	0.5165	0.7755	0.8806
No log	0.9681	394	0.6010	0.5651	0.6010	0.7753
No log	0.9730	396	0.5072	0.5756	0.5072	0.7122
No log	0.9779	398	0.5508	0.5799	0.5508	0.7422
No log	0.9828	400	0.6093	0.5552	0.6093	0.7806
No log	0.9877	402	0.7580	0.5384	0.7580	0.8706
No log	0.9926	404	0.7525	0.5377	0.7525	0.8675
No log	0.9975	406	0.6594	0.5489	0.6594	0.8120
No log	1.0025	408	0.6561	0.5508	0.6561	0.8100
No log	1.0074	410	0.5611	0.5819	0.5611	0.7490
No log	1.0123	412	0.5213	0.5625	0.5213	0.7220
No log	1.0172	414	0.5723	0.5771	0.5723	0.7565
No log	1.0221	416	0.5687	0.5930	0.5687	0.7541
No log	1.0270	418	0.4838	0.6001	0.4838	0.6956
No log	1.0319	420	0.4607	0.6038	0.4607	0.6788
No log	1.0369	422	0.4615	0.6063	0.4615	0.6794
No log	1.0418	424	0.4450	0.5948	0.4450	0.6671
No log	1.0467	426	0.4441	0.6054	0.4441	0.6664
No log	1.0516	428	0.4670	0.6159	0.4670	0.6834
No log	1.0565	430	0.5026	0.6090	0.5026	0.7090
No log	1.0614	432	0.4743	0.5952	0.4743	0.6887
No log	1.0663	434	0.4243	0.5902	0.4243	0.6514
No log	1.0713	436	0.4351	0.5888	0.4351	0.6596
No log	1.0762	438	0.4700	0.6032	0.4700	0.6855
No log	1.0811	440	0.4343	0.5845	0.4343	0.6590
No log	1.0860	442	0.4483	0.5462	0.4483	0.6696
No log	1.0909	444	0.4533	0.5365	0.4533	0.6733
No log	1.0958	446	0.4362	0.5746	0.4362	0.6605
No log	1.1007	448	0.4928	0.5906	0.4928	0.7020
No log	1.1057	450	0.5399	0.6173	0.5399	0.7348
No log	1.1106	452	0.4619	0.5991	0.4619	0.6797
No log	1.1155	454	0.4252	0.5727	0.4252	0.6521
No log	1.1204	456	0.4228	0.5741	0.4228	0.6502
No log	1.1253	458	0.4567	0.6257	0.4567	0.6758
No log	1.1302	460	0.6388	0.6334	0.6388	0.7992
No log	1.1351	462	0.6192	0.6482	0.6192	0.7869
No log	1.1400	464	0.4595	0.6285	0.4595	0.6778
No log	1.1450	466	0.4330	0.5952	0.4330	0.6580
No log	1.1499	468	0.4991	0.6471	0.4991	0.7065
No log	1.1548	470	0.6608	0.7030	0.6608	0.8129
No log	1.1597	472	0.5729	0.6976	0.5729	0.7569
No log	1.1646	474	0.4662	0.6349	0.4662	0.6828
No log	1.1695	476	0.4311	0.6056	0.4311	0.6566
No log	1.1744	478	0.4604	0.6280	0.4604	0.6786
No log	1.1794	480	0.5520	0.6610	0.5520	0.7430
No log	1.1843	482	0.5067	0.6294	0.5067	0.7118
No log	1.1892	484	0.4372	0.5604	0.4372	0.6612
No log	1.1941	486	0.4510	0.4927	0.4510	0.6716
No log	1.1990	488	0.4446	0.4944	0.4446	0.6668
No log	1.2039	490	0.4548	0.5763	0.4548	0.6744
No log	1.2088	492	0.4975	0.6070	0.4975	0.7053
No log	1.2138	494	0.5297	0.6055	0.5297	0.7278
No log	1.2187	496	0.5612	0.6027	0.5612	0.7492
No log	1.2236	498	0.4947	0.5789	0.4947	0.7034
0.5107	1.2285	500	0.4709	0.5476	0.4709	0.6862
0.5107	1.2334	502	0.4801	0.5732	0.4801	0.6929
0.5107	1.2383	504	0.5205	0.5463	0.5205	0.7215
0.5107	1.2432	506	0.6151	0.5699	0.6151	0.7843
0.5107	1.2482	508	0.5700	0.5693	0.5700	0.7550
0.5107	1.2531	510	0.4834	0.5265	0.4834	0.6953
0.5107	1.2580	512	0.4777	0.5232	0.4777	0.6912
0.5107	1.2629	514	0.5004	0.5599	0.5004	0.7074
0.5107	1.2678	516	0.6491	0.5823	0.6491	0.8056
0.5107	1.2727	518	0.7351	0.6037	0.7351	0.8574
0.5107	1.2776	520	0.5979	0.5796	0.5979	0.7733
0.5107	1.2826	522	0.4755	0.5737	0.4755	0.6896
0.5107	1.2875	524	0.4747	0.4636	0.4747	0.6890
0.5107	1.2924	526	0.4686	0.4788	0.4686	0.6845
0.5107	1.2973	528	0.4581	0.5544	0.4581	0.6768
0.5107	1.3022	530	0.5497	0.6133	0.5497	0.7414
0.5107	1.3071	532	0.5933	0.6177	0.5933	0.7703
0.5107	1.3120	534	0.4957	0.5906	0.4957	0.7041
0.5107	1.3170	536	0.4449	0.5474	0.4449	0.6670
0.5107	1.3219	538	0.4461	0.5397	0.4461	0.6679
0.5107	1.3268	540	0.4911	0.5874	0.4911	0.7008
0.5107	1.3317	542	0.5566	0.6092	0.5566	0.7461
0.5107	1.3366	544	0.6142	0.5899	0.6142	0.7837
0.5107	1.3415	546	0.5344	0.5407	0.5344	0.7310
0.5107	1.3464	548	0.5157	0.4574	0.5157	0.7181
0.5107	1.3514	550	0.5250	0.4391	0.5250	0.7246
0.5107	1.3563	552	0.5342	0.4987	0.5342	0.7309
0.5107	1.3612	554	0.5742	0.5276	0.5742	0.7578

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1