ASAP_FineTuningBERT_AugV3_k1_task1_organization_fold3

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5238
• Qwk: 0.4527
• Mse: 0.5238
• Rmse: 0.7238

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0136	2	11.4639	0.0	11.4639	3.3858
No log	0.0272	4	9.0306	0.0012	9.0306	3.0051
No log	0.0408	6	8.3258	0.0122	8.3258	2.8854
No log	0.0544	8	7.3085	0.0	7.3085	2.7034
No log	0.0680	10	6.1222	0.0	6.1222	2.4743
No log	0.0816	12	5.3640	0.0	5.3640	2.3160
No log	0.0952	14	4.6262	0.0	4.6262	2.1509
No log	0.1088	16	3.8236	0.0365	3.8236	1.9554
No log	0.1224	18	3.0723	0.0038	3.0723	1.7528
No log	0.1361	20	2.4022	0.0	2.4022	1.5499
No log	0.1497	22	1.8133	0.0	1.8133	1.3466
No log	0.1633	24	1.9105	0.0	1.9105	1.3822
No log	0.1769	26	1.7754	-0.0015	1.7754	1.3324
No log	0.1905	28	1.3388	0.0992	1.3388	1.1571
No log	0.2041	30	1.5200	0.0281	1.5200	1.2329
No log	0.2177	32	2.5652	0.0076	2.5652	1.6016
No log	0.2313	34	2.5366	0.0076	2.5366	1.5927
No log	0.2449	36	1.5965	0.0350	1.5965	1.2635
No log	0.2585	38	1.1513	0.0647	1.1513	1.0730
No log	0.2721	40	1.1492	0.0625	1.1492	1.0720
No log	0.2857	42	1.2364	0.0842	1.2364	1.1120
No log	0.2993	44	1.3704	0.0545	1.3704	1.1706
No log	0.3129	46	1.2631	0.0757	1.2631	1.1239
No log	0.3265	48	1.1276	0.0623	1.1276	1.0619
No log	0.3401	50	1.1232	0.0610	1.1232	1.0598
No log	0.3537	52	1.1286	0.0514	1.1286	1.0624
No log	0.3673	54	1.0311	0.0514	1.0311	1.0155
No log	0.3810	56	1.0413	0.0636	1.0413	1.0205
No log	0.3946	58	1.1016	0.0498	1.1016	1.0496
No log	0.4082	60	0.9965	0.0591	0.9965	0.9983
No log	0.4218	62	0.8786	0.0574	0.8786	0.9373
No log	0.4354	64	0.8456	0.0574	0.8456	0.9195
No log	0.4490	66	0.8331	0.0528	0.8331	0.9128
No log	0.4626	68	0.8282	0.0528	0.8282	0.9100
No log	0.4762	70	0.8259	0.0623	0.8259	0.9088
No log	0.4898	72	0.8152	0.0601	0.8152	0.9029
No log	0.5034	74	0.8004	0.0601	0.8004	0.8946
No log	0.5170	76	0.8045	0.0661	0.8045	0.8970
No log	0.5306	78	0.7996	0.1773	0.7996	0.8942
No log	0.5442	80	0.7865	0.2136	0.7865	0.8868
No log	0.5578	82	0.7734	0.2735	0.7734	0.8794
No log	0.5714	84	0.7478	0.2254	0.7478	0.8648
No log	0.5850	86	0.7297	0.1177	0.7297	0.8542
No log	0.5986	88	0.7216	0.1106	0.7216	0.8495
No log	0.6122	90	0.7045	0.1627	0.7045	0.8393
No log	0.6259	92	0.6989	0.3412	0.6989	0.8360
No log	0.6395	94	0.6821	0.3517	0.6821	0.8259
No log	0.6531	96	0.6567	0.3389	0.6567	0.8104
No log	0.6667	98	0.6496	0.3422	0.6496	0.8060
No log	0.6803	100	0.6308	0.3156	0.6308	0.7942
No log	0.6939	102	0.6344	0.3150	0.6344	0.7965
No log	0.7075	104	0.6928	0.1841	0.6928	0.8323
No log	0.7211	106	0.8449	0.1419	0.8449	0.9192
No log	0.7347	108	0.6902	0.2791	0.6902	0.8308
No log	0.7483	110	0.6765	0.3824	0.6765	0.8225
No log	0.7619	112	0.7059	0.4463	0.7059	0.8402
No log	0.7755	114	0.6232	0.5005	0.6232	0.7894
No log	0.7891	116	0.5707	0.4511	0.5707	0.7555
No log	0.8027	118	0.5797	0.4047	0.5797	0.7614
No log	0.8163	120	0.5774	0.4070	0.5774	0.7599
No log	0.8299	122	0.5867	0.5263	0.5867	0.7660
No log	0.8435	124	0.7038	0.4924	0.7038	0.8389
No log	0.8571	126	0.6738	0.5043	0.6738	0.8208
No log	0.8707	128	0.9021	0.4003	0.9021	0.9498
No log	0.8844	130	1.9363	0.2185	1.9363	1.3915
No log	0.8980	132	1.0463	0.3296	1.0463	1.0229
No log	0.9116	134	0.6398	0.4895	0.6398	0.7999
No log	0.9252	136	0.8138	0.3769	0.8138	0.9021
No log	0.9388	138	0.8660	0.3623	0.8660	0.9306
No log	0.9524	140	0.7817	0.3878	0.7817	0.8841
No log	0.9660	142	0.7070	0.4118	0.7070	0.8408
No log	0.9796	144	0.6535	0.2929	0.6535	0.8084
No log	0.9932	146	0.6725	0.1665	0.6725	0.8200
No log	1.0068	148	0.6940	0.1446	0.6940	0.8331
No log	1.0204	150	0.6684	0.1755	0.6684	0.8176
No log	1.0340	152	0.7207	0.2152	0.7207	0.8489
No log	1.0476	154	0.6172	0.2827	0.6172	0.7856
No log	1.0612	156	0.5550	0.4825	0.5550	0.7450
No log	1.0748	158	0.6560	0.4940	0.6560	0.8100
No log	1.0884	160	0.7505	0.4396	0.7505	0.8663
No log	1.1020	162	0.7117	0.4507	0.7117	0.8436
No log	1.1156	164	0.6196	0.5026	0.6196	0.7872
No log	1.1293	166	0.5686	0.4359	0.5686	0.7540
No log	1.1429	168	0.6860	0.3734	0.6860	0.8282
No log	1.1565	170	0.6813	0.3771	0.6813	0.8254
No log	1.1701	172	0.5803	0.4325	0.5803	0.7618
No log	1.1837	174	0.5561	0.5091	0.5561	0.7457
No log	1.1973	176	0.6573	0.4198	0.6573	0.8107
No log	1.2109	178	0.6363	0.4649	0.6363	0.7977
No log	1.2245	180	0.5693	0.5596	0.5693	0.7545
No log	1.2381	182	0.5265	0.5490	0.5265	0.7256
No log	1.2517	184	0.5463	0.4701	0.5463	0.7391
No log	1.2653	186	0.5819	0.4160	0.5819	0.7628
No log	1.2789	188	0.5526	0.4350	0.5526	0.7434
No log	1.2925	190	0.5028	0.5329	0.5028	0.7091
No log	1.3061	192	0.5383	0.5657	0.5383	0.7337
No log	1.3197	194	0.5629	0.5670	0.5629	0.7502
No log	1.3333	196	0.5450	0.5622	0.5450	0.7383
No log	1.3469	198	0.4897	0.5234	0.4897	0.6998
No log	1.3605	200	0.4984	0.4876	0.4984	0.7060
No log	1.3741	202	0.5089	0.4671	0.5089	0.7133
No log	1.3878	204	0.4864	0.4983	0.4864	0.6974
No log	1.4014	206	0.5135	0.5597	0.5135	0.7166
No log	1.4150	208	0.5865	0.5443	0.5865	0.7658
No log	1.4286	210	0.5330	0.5639	0.5330	0.7301
No log	1.4422	212	0.4828	0.4964	0.4828	0.6948
No log	1.4558	214	0.4904	0.4714	0.4904	0.7003
No log	1.4694	216	0.4851	0.4918	0.4851	0.6965
No log	1.4830	218	0.5858	0.5584	0.5858	0.7654
No log	1.4966	220	0.7257	0.5227	0.7257	0.8519
No log	1.5102	222	0.6929	0.5297	0.6929	0.8324
No log	1.5238	224	0.5294	0.5745	0.5294	0.7276
No log	1.5374	226	0.4822	0.5010	0.4822	0.6944
No log	1.5510	228	0.4827	0.5005	0.4827	0.6948
No log	1.5646	230	0.4969	0.5417	0.4969	0.7049
No log	1.5782	232	0.5979	0.5483	0.5979	0.7732
No log	1.5918	234	0.6044	0.5492	0.6044	0.7774
No log	1.6054	236	0.5303	0.5720	0.5303	0.7282
No log	1.6190	238	0.4883	0.5408	0.4883	0.6988
No log	1.6327	240	0.4865	0.5102	0.4865	0.6975
No log	1.6463	242	0.4918	0.5351	0.4918	0.7013
No log	1.6599	244	0.5010	0.5078	0.5010	0.7078
No log	1.6735	246	0.5250	0.5374	0.5250	0.7246
No log	1.6871	248	0.5592	0.5540	0.5592	0.7478
No log	1.7007	250	0.5705	0.5540	0.5705	0.7553
No log	1.7143	252	0.5597	0.5462	0.5597	0.7481
No log	1.7279	254	0.5438	0.4998	0.5438	0.7374
No log	1.7415	256	0.5335	0.5003	0.5335	0.7304
No log	1.7551	258	0.5852	0.5633	0.5852	0.7650
No log	1.7687	260	0.6977	0.5605	0.6977	0.8353
No log	1.7823	262	0.7268	0.5680	0.7268	0.8525
No log	1.7959	264	0.6431	0.5649	0.6431	0.8020
No log	1.8095	266	0.5457	0.5480	0.5457	0.7387
No log	1.8231	268	0.4941	0.5146	0.4941	0.7029
No log	1.8367	270	0.5312	0.4348	0.5312	0.7288
No log	1.8503	272	0.5651	0.4208	0.5651	0.7518
No log	1.8639	274	0.5322	0.4214	0.5322	0.7295
No log	1.8776	276	0.4915	0.5233	0.4915	0.7011
No log	1.8912	278	0.6438	0.5572	0.6438	0.8024
No log	1.9048	280	0.7102	0.5591	0.7102	0.8427
No log	1.9184	282	0.6722	0.5626	0.6722	0.8199
No log	1.9320	284	0.5984	0.5674	0.5984	0.7735
No log	1.9456	286	0.5097	0.5585	0.5097	0.7139
No log	1.9592	288	0.4912	0.5155	0.4912	0.7008
No log	1.9728	290	0.4921	0.5015	0.4921	0.7015
No log	1.9864	292	0.5141	0.4515	0.5141	0.7170
No log	2.0	294	0.4831	0.4996	0.4831	0.6951
No log	2.0136	296	0.5110	0.5522	0.5110	0.7148
No log	2.0272	298	0.5483	0.5622	0.5483	0.7405
No log	2.0408	300	0.5668	0.5496	0.5668	0.7529
No log	2.0544	302	0.5371	0.5450	0.5371	0.7329
No log	2.0680	304	0.5028	0.5328	0.5028	0.7091
No log	2.0816	306	0.4896	0.4954	0.4896	0.6997
No log	2.0952	308	0.5044	0.5349	0.5044	0.7102
No log	2.1088	310	0.5718	0.5534	0.5718	0.7562
No log	2.1224	312	0.6424	0.5532	0.6424	0.8015
No log	2.1361	314	0.6414	0.5608	0.6414	0.8009
No log	2.1497	316	0.6219	0.5745	0.6219	0.7886
No log	2.1633	318	0.5977	0.5759	0.5977	0.7731
No log	2.1769	320	0.5352	0.5709	0.5352	0.7315
No log	2.1905	322	0.4924	0.5204	0.4924	0.7017
No log	2.2041	324	0.4857	0.5000	0.4857	0.6969
No log	2.2177	326	0.4891	0.5342	0.4891	0.6994
No log	2.2313	328	0.4853	0.5223	0.4853	0.6966
No log	2.2449	330	0.4849	0.5158	0.4849	0.6963
No log	2.2585	332	0.4982	0.4826	0.4982	0.7058
No log	2.2721	334	0.5014	0.4975	0.5014	0.7081
No log	2.2857	336	0.5199	0.5532	0.5199	0.7211
No log	2.2993	338	0.6230	0.5801	0.6230	0.7893
No log	2.3129	340	0.6403	0.5872	0.6403	0.8002
No log	2.3265	342	0.5727	0.5949	0.5727	0.7568
No log	2.3401	344	0.5298	0.4879	0.5298	0.7279
No log	2.3537	346	0.6590	0.4070	0.6590	0.8118
No log	2.3673	348	0.6931	0.3942	0.6931	0.8325
No log	2.3810	350	0.7236	0.3757	0.7236	0.8506
No log	2.3946	352	0.6332	0.4187	0.6332	0.7957
No log	2.4082	354	0.5278	0.4636	0.5278	0.7265
No log	2.4218	356	0.5064	0.5355	0.5064	0.7116
No log	2.4354	358	0.6095	0.5884	0.6095	0.7807
No log	2.4490	360	0.6284	0.5838	0.6284	0.7927
No log	2.4626	362	0.5555	0.5783	0.5555	0.7453
No log	2.4762	364	0.5493	0.5728	0.5493	0.7412
No log	2.4898	366	0.4873	0.5495	0.4873	0.6981
No log	2.5034	368	0.4771	0.4989	0.4771	0.6908
No log	2.5170	370	0.4845	0.4900	0.4845	0.6961
No log	2.5306	372	0.4739	0.4927	0.4739	0.6884
No log	2.5442	374	0.4820	0.5397	0.4820	0.6943
No log	2.5578	376	0.5131	0.5671	0.5131	0.7163
No log	2.5714	378	0.5490	0.5747	0.5490	0.7409
No log	2.5850	380	0.5527	0.5762	0.5527	0.7434
No log	2.5986	382	0.5364	0.5699	0.5364	0.7324
No log	2.6122	384	0.5435	0.5690	0.5435	0.7372
No log	2.6259	386	0.5633	0.5755	0.5633	0.7505
No log	2.6395	388	0.5473	0.5734	0.5473	0.7398
No log	2.6531	390	0.5415	0.5732	0.5415	0.7359
No log	2.6667	392	0.5120	0.5271	0.5120	0.7155
No log	2.6803	394	0.5173	0.4792	0.5173	0.7192
No log	2.6939	396	0.5512	0.4470	0.5512	0.7424
No log	2.7075	398	0.5603	0.4458	0.5603	0.7486
No log	2.7211	400	0.5641	0.4417	0.5641	0.7511
No log	2.7347	402	0.4905	0.4931	0.4905	0.7004
No log	2.7483	404	0.5352	0.5629	0.5352	0.7316
No log	2.7619	406	0.7192	0.5556	0.7192	0.8481
No log	2.7755	408	0.8603	0.5267	0.8603	0.9275
No log	2.7891	410	0.8931	0.5039	0.8931	0.9451
No log	2.8027	412	0.7315	0.5125	0.7315	0.8553
No log	2.8163	414	0.5663	0.5293	0.5663	0.7525
No log	2.8299	416	0.4971	0.4981	0.4971	0.7051
No log	2.8435	418	0.5020	0.4510	0.5020	0.7085
No log	2.8571	420	0.4899	0.4731	0.4899	0.6999
No log	2.8707	422	0.4892	0.5157	0.4892	0.6994
No log	2.8844	424	0.5774	0.5599	0.5774	0.7599
No log	2.8980	426	0.6391	0.5377	0.6391	0.7994
No log	2.9116	428	0.5876	0.5707	0.5876	0.7666
No log	2.9252	430	0.4930	0.5706	0.4930	0.7021
No log	2.9388	432	0.4607	0.5299	0.4607	0.6788
No log	2.9524	434	0.4632	0.5237	0.4632	0.6806
No log	2.9660	436	0.4829	0.5592	0.4829	0.6949
No log	2.9796	438	0.5325	0.5864	0.5325	0.7297
No log	2.9932	440	0.5682	0.6020	0.5682	0.7538
No log	3.0068	442	0.5487	0.5950	0.5487	0.7407
No log	3.0204	444	0.5299	0.5779	0.5299	0.7279
No log	3.0340	446	0.5403	0.5863	0.5403	0.7350
No log	3.0476	448	0.4921	0.5480	0.4921	0.7015
No log	3.0612	450	0.4901	0.5364	0.4901	0.7001
No log	3.0748	452	0.5156	0.5548	0.5156	0.7181
No log	3.0884	454	0.5150	0.5510	0.5150	0.7177
No log	3.1020	456	0.5142	0.5530	0.5142	0.7171
No log	3.1156	458	0.5142	0.5571	0.5142	0.7171
No log	3.1293	460	0.5196	0.5611	0.5196	0.7208
No log	3.1429	462	0.5454	0.5868	0.5454	0.7385
No log	3.1565	464	0.5529	0.5958	0.5529	0.7436
No log	3.1701	466	0.5315	0.5888	0.5315	0.7290
No log	3.1837	468	0.5453	0.5970	0.5453	0.7384
No log	3.1973	470	0.5375	0.5999	0.5375	0.7332
No log	3.2109	472	0.5137	0.5886	0.5137	0.7167
No log	3.2245	474	0.4667	0.5800	0.4667	0.6831
No log	3.2381	476	0.4524	0.5126	0.4524	0.6726
No log	3.2517	478	0.4711	0.4800	0.4711	0.6863
No log	3.2653	480	0.4676	0.4972	0.4676	0.6838
No log	3.2789	482	0.4721	0.5517	0.4721	0.6871
No log	3.2925	484	0.5470	0.5798	0.5470	0.7396
No log	3.3061	486	0.6291	0.5845	0.6291	0.7931
No log	3.3197	488	0.6522	0.5733	0.6522	0.8076
No log	3.3333	490	0.6262	0.5793	0.6262	0.7914
No log	3.3469	492	0.5827	0.5852	0.5827	0.7634
No log	3.3605	494	0.5407	0.5836	0.5407	0.7353
No log	3.3741	496	0.4730	0.5990	0.4730	0.6877
No log	3.3878	498	0.4448	0.5556	0.4448	0.6670
1.3331	3.4014	500	0.4471	0.5441	0.4471	0.6686
1.3331	3.4150	502	0.4494	0.5373	0.4494	0.6704
1.3331	3.4286	504	0.4530	0.5455	0.4530	0.6730
1.3331	3.4422	506	0.4661	0.5806	0.4661	0.6827
1.3331	3.4558	508	0.4931	0.6053	0.4931	0.7022
1.3331	3.4694	510	0.6043	0.6005	0.6043	0.7774
1.3331	3.4830	512	0.7685	0.5512	0.7685	0.8766
1.3331	3.4966	514	0.8293	0.5337	0.8293	0.9107
1.3331	3.5102	516	0.7257	0.5523	0.7257	0.8519
1.3331	3.5238	518	0.5547	0.6085	0.5547	0.7448
1.3331	3.5374	520	0.4555	0.5841	0.4555	0.6749
1.3331	3.5510	522	0.4388	0.5235	0.4388	0.6624
1.3331	3.5646	524	0.4521	0.4878	0.4521	0.6724
1.3331	3.5782	526	0.4791	0.4568	0.4791	0.6921
1.3331	3.5918	528	0.4990	0.4571	0.4990	0.7064
1.3331	3.6054	530	0.5238	0.4527	0.5238	0.7238

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1