ASAP_FineTuningBERT_AugV3_k1_task1_organization_fold2

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.4759
• Qwk: 0.5818
• Mse: 0.4759
• Rmse: 0.6899

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0136	2	10.8041	0.0	10.8041	3.2870
No log	0.0272	4	9.1894	0.0024	9.1894	3.0314
No log	0.0408	6	7.4277	0.0036	7.4277	2.7254
No log	0.0544	8	5.9056	-0.0005	5.9056	2.4301
No log	0.0680	10	5.1723	0.0	5.1723	2.2743
No log	0.0816	12	4.0278	0.0084	4.0278	2.0069
No log	0.0952	14	3.2598	0.0219	3.2598	1.8055
No log	0.1088	16	2.6156	0.0078	2.6156	1.6173
No log	0.1224	18	2.1014	0.0	2.1014	1.4496
No log	0.1361	20	1.6794	0.0	1.6794	1.2959
No log	0.1497	22	1.6721	-0.0119	1.6721	1.2931
No log	0.1633	24	1.6486	-0.0429	1.6486	1.2840
No log	0.1769	26	1.5464	-0.0500	1.5464	1.2436
No log	0.1905	28	1.8388	-0.0164	1.8388	1.3560
No log	0.2041	30	1.4408	-0.0369	1.4408	1.2003
No log	0.2177	32	1.3215	0.0516	1.3215	1.1496
No log	0.2313	34	1.4411	-0.0137	1.4411	1.2005
No log	0.2449	36	1.7947	-0.0003	1.7947	1.3397
No log	0.2585	38	1.8195	0.0004	1.8195	1.3489
No log	0.2721	40	1.7557	-0.0025	1.7557	1.3250
No log	0.2857	42	1.4690	-0.0094	1.4690	1.2120
No log	0.2993	44	1.2259	0.0628	1.2259	1.1072
No log	0.3129	46	1.1664	0.0640	1.1664	1.0800
No log	0.3265	48	1.2713	0.0396	1.2713	1.1275
No log	0.3401	50	1.1520	0.1061	1.1520	1.0733
No log	0.3537	52	1.0081	0.1003	1.0081	1.0040
No log	0.3673	54	1.0105	0.1167	1.0105	1.0052
No log	0.3810	56	1.0468	0.1197	1.0468	1.0231
No log	0.3946	58	1.0317	0.1260	1.0317	1.0157
No log	0.4082	60	1.0318	0.1084	1.0318	1.0158
No log	0.4218	62	0.9404	0.0976	0.9404	0.9698
No log	0.4354	64	0.8516	0.1042	0.8516	0.9228
No log	0.4490	66	0.7993	0.0923	0.7993	0.8940
No log	0.4626	68	0.7687	0.0917	0.7687	0.8768
No log	0.4762	70	0.7421	0.0847	0.7421	0.8615
No log	0.4898	72	0.7271	0.1125	0.7271	0.8527
No log	0.5034	74	0.7227	0.1198	0.7227	0.8501
No log	0.5170	76	0.7647	0.0854	0.7647	0.8745
No log	0.5306	78	0.8364	0.0625	0.8364	0.9146
No log	0.5442	80	0.7653	0.0867	0.7653	0.8748
No log	0.5578	82	0.7267	0.1101	0.7267	0.8525
No log	0.5714	84	0.7191	0.1460	0.7191	0.8480
No log	0.5850	86	0.7466	0.0686	0.7466	0.8640
No log	0.5986	88	0.8161	0.0551	0.8161	0.9034
No log	0.6122	90	0.7282	0.0551	0.7282	0.8534
No log	0.6259	92	0.6713	0.1108	0.6713	0.8193
No log	0.6395	94	0.7412	0.1275	0.7412	0.8609
No log	0.6531	96	0.7183	0.1191	0.7183	0.8475
No log	0.6667	98	0.6955	0.1207	0.6955	0.8340
No log	0.6803	100	0.6694	0.4370	0.6694	0.8182
No log	0.6939	102	0.7617	0.2915	0.7617	0.8728
No log	0.7075	104	0.7938	0.0547	0.7938	0.8910
No log	0.7211	106	0.7990	0.0417	0.7990	0.8939
No log	0.7347	108	0.8071	0.2601	0.8071	0.8984
No log	0.7483	110	0.8174	0.3298	0.8174	0.9041
No log	0.7619	112	0.7180	0.4270	0.7180	0.8474
No log	0.7755	114	0.6822	0.1511	0.6822	0.8259
No log	0.7891	116	0.6625	0.2005	0.6625	0.8139
No log	0.8027	118	0.7006	0.4736	0.7006	0.8370
No log	0.8163	120	0.7359	0.4394	0.7359	0.8579
No log	0.8299	122	0.7901	0.3554	0.7901	0.8889
No log	0.8435	124	0.8344	0.3384	0.8344	0.9134
No log	0.8571	126	0.8695	0.3088	0.8695	0.9325
No log	0.8707	128	0.8446	0.3281	0.8446	0.9190
No log	0.8844	130	0.7945	0.3516	0.7945	0.8914
No log	0.8980	132	0.6920	0.4711	0.6920	0.8318
No log	0.9116	134	0.6191	0.4489	0.6191	0.7868
No log	0.9252	136	0.6148	0.4744	0.6148	0.7841
No log	0.9388	138	0.6011	0.4813	0.6011	0.7753
No log	0.9524	140	0.5650	0.4260	0.5650	0.7516
No log	0.9660	142	0.6017	0.2833	0.6017	0.7757
No log	0.9796	144	0.5866	0.2951	0.5866	0.7659
No log	0.9932	146	0.5512	0.4263	0.5512	0.7425
No log	1.0068	148	0.5997	0.4906	0.5997	0.7744
No log	1.0204	150	0.6353	0.5012	0.6353	0.7970
No log	1.0340	152	0.5714	0.4908	0.5714	0.7559
No log	1.0476	154	0.4973	0.4792	0.4973	0.7052
No log	1.0612	156	0.5402	0.4069	0.5402	0.7350
No log	1.0748	158	0.5520	0.3916	0.5520	0.7430
No log	1.0884	160	0.5095	0.4451	0.5095	0.7138
No log	1.1020	162	0.5028	0.4595	0.5028	0.7091
No log	1.1156	164	0.5319	0.4780	0.5319	0.7293
No log	1.1293	166	0.5603	0.4663	0.5603	0.7485
No log	1.1429	168	0.5605	0.4634	0.5605	0.7486
No log	1.1565	170	0.5308	0.4581	0.5308	0.7285
No log	1.1701	172	0.5029	0.5183	0.5029	0.7091
No log	1.1837	174	0.4579	0.5446	0.4579	0.6767
No log	1.1973	176	0.4411	0.5435	0.4411	0.6641
No log	1.2109	178	0.4772	0.4613	0.4772	0.6908
No log	1.2245	180	0.4509	0.5260	0.4509	0.6715
No log	1.2381	182	0.4603	0.5739	0.4603	0.6784
No log	1.2517	184	0.5223	0.5457	0.5223	0.7227
No log	1.2653	186	0.5180	0.5386	0.5180	0.7197
No log	1.2789	188	0.4685	0.5198	0.4685	0.6845
No log	1.2925	190	0.5065	0.4344	0.5065	0.7117
No log	1.3061	192	0.5372	0.4282	0.5372	0.7329
No log	1.3197	194	0.4890	0.4685	0.4890	0.6993
No log	1.3333	196	0.4480	0.5402	0.4480	0.6693
No log	1.3469	198	0.4485	0.5659	0.4485	0.6697
No log	1.3605	200	0.5364	0.5872	0.5364	0.7324
No log	1.3741	202	0.5370	0.5889	0.5370	0.7328
No log	1.3878	204	0.6123	0.5778	0.6123	0.7825
No log	1.4014	206	0.6662	0.5653	0.6662	0.8162
No log	1.4150	208	0.6569	0.5704	0.6569	0.8105
No log	1.4286	210	0.5928	0.5772	0.5928	0.7699
No log	1.4422	212	0.4511	0.5692	0.4511	0.6716
No log	1.4558	214	0.5140	0.4098	0.5140	0.7170
No log	1.4694	216	0.6293	0.2952	0.6293	0.7933
No log	1.4830	218	0.5192	0.4006	0.5192	0.7206
No log	1.4966	220	0.4382	0.5426	0.4382	0.6620
No log	1.5102	222	0.5143	0.5687	0.5143	0.7172
No log	1.5238	224	0.5363	0.5205	0.5363	0.7323
No log	1.5374	226	0.5489	0.4993	0.5489	0.7409
No log	1.5510	228	0.5220	0.5217	0.5220	0.7225
No log	1.5646	230	0.4726	0.5017	0.4726	0.6874
No log	1.5782	232	0.4451	0.5270	0.4451	0.6672
No log	1.5918	234	0.4342	0.5343	0.4342	0.6589
No log	1.6054	236	0.4400	0.5092	0.4400	0.6633
No log	1.6190	238	0.4772	0.4550	0.4772	0.6908
No log	1.6327	240	0.4906	0.4400	0.4906	0.7004
No log	1.6463	242	0.4652	0.4327	0.4652	0.6821
No log	1.6599	244	0.4364	0.5122	0.4364	0.6606
No log	1.6735	246	0.4704	0.5380	0.4704	0.6859
No log	1.6871	248	0.5145	0.5186	0.5145	0.7173
No log	1.7007	250	0.5161	0.5105	0.5161	0.7184
No log	1.7143	252	0.5060	0.5086	0.5060	0.7114
No log	1.7279	254	0.4553	0.5238	0.4553	0.6747
No log	1.7415	256	0.4368	0.5344	0.4368	0.6609
No log	1.7551	258	0.4387	0.5631	0.4387	0.6623
No log	1.7687	260	0.4371	0.5589	0.4371	0.6611
No log	1.7823	262	0.4326	0.5606	0.4326	0.6578
No log	1.7959	264	0.4420	0.5462	0.4420	0.6648
No log	1.8095	266	0.4562	0.5095	0.4562	0.6754
No log	1.8231	268	0.4188	0.5716	0.4188	0.6472
No log	1.8367	270	0.5010	0.5757	0.5010	0.7078
No log	1.8503	272	0.5400	0.5622	0.5400	0.7349
No log	1.8639	274	0.5929	0.5480	0.5929	0.7700
No log	1.8776	276	0.5873	0.5467	0.5873	0.7664
No log	1.8912	278	0.5275	0.5615	0.5275	0.7263
No log	1.9048	280	0.4633	0.5533	0.4633	0.6807
No log	1.9184	282	0.4463	0.5223	0.4463	0.6680
No log	1.9320	284	0.4360	0.5022	0.4360	0.6603
No log	1.9456	286	0.4335	0.4523	0.4335	0.6584
No log	1.9592	288	0.4290	0.4723	0.4290	0.6550
No log	1.9728	290	0.4260	0.4766	0.4260	0.6527
No log	1.9864	292	0.4590	0.4467	0.4590	0.6775
No log	2.0	294	0.4138	0.5015	0.4138	0.6433
No log	2.0136	296	0.4261	0.5465	0.4261	0.6528
No log	2.0272	298	0.4774	0.5841	0.4774	0.6909
No log	2.0408	300	0.4785	0.5825	0.4785	0.6917
No log	2.0544	302	0.4299	0.5487	0.4299	0.6557
No log	2.0680	304	0.4119	0.5059	0.4119	0.6418
No log	2.0816	306	0.4289	0.5498	0.4289	0.6549
No log	2.0952	308	0.4520	0.5695	0.4520	0.6723
No log	2.1088	310	0.4534	0.5811	0.4534	0.6733
No log	2.1224	312	0.4057	0.5555	0.4057	0.6370
No log	2.1361	314	0.3909	0.5293	0.3909	0.6252
No log	2.1497	316	0.3902	0.5263	0.3902	0.6247
No log	2.1633	318	0.4020	0.5792	0.4020	0.6340
No log	2.1769	320	0.5039	0.5998	0.5039	0.7098
No log	2.1905	322	0.6132	0.5883	0.6132	0.7831
No log	2.2041	324	0.6477	0.5750	0.6477	0.8048
No log	2.2177	326	0.5245	0.5997	0.5245	0.7243
No log	2.2313	328	0.4214	0.5805	0.4214	0.6491
No log	2.2449	330	0.4287	0.5230	0.4287	0.6547
No log	2.2585	332	0.4307	0.5154	0.4307	0.6563
No log	2.2721	334	0.4148	0.5383	0.4148	0.6440
No log	2.2857	336	0.4470	0.5595	0.4470	0.6685
No log	2.2993	338	0.4941	0.5731	0.4941	0.7029
No log	2.3129	340	0.5337	0.5663	0.5337	0.7306
No log	2.3265	342	0.4764	0.5545	0.4764	0.6903
No log	2.3401	344	0.4258	0.5344	0.4258	0.6526
No log	2.3537	346	0.4199	0.4695	0.4199	0.6480
No log	2.3673	348	0.4424	0.4637	0.4424	0.6652
No log	2.3810	350	0.4226	0.4814	0.4226	0.6501
No log	2.3946	352	0.4165	0.5326	0.4165	0.6454
No log	2.4082	354	0.4966	0.5569	0.4966	0.7047
No log	2.4218	356	0.5502	0.5729	0.5502	0.7418
No log	2.4354	358	0.5093	0.5353	0.5093	0.7137
No log	2.4490	360	0.4872	0.5291	0.4872	0.6980
No log	2.4626	362	0.4420	0.5328	0.4420	0.6648
No log	2.4762	364	0.4199	0.5439	0.4199	0.6480
No log	2.4898	366	0.4135	0.5453	0.4135	0.6431
No log	2.5034	368	0.3975	0.5281	0.3975	0.6305
No log	2.5170	370	0.4160	0.4916	0.4160	0.6450
No log	2.5306	372	0.4685	0.4596	0.4685	0.6845
No log	2.5442	374	0.4554	0.4622	0.4554	0.6748
No log	2.5578	376	0.3944	0.5414	0.3944	0.6280
No log	2.5714	378	0.4477	0.5712	0.4477	0.6691
No log	2.5850	380	0.5273	0.5761	0.5273	0.7262
No log	2.5986	382	0.6133	0.5499	0.6133	0.7831
No log	2.6122	384	0.6492	0.5346	0.6492	0.8057
No log	2.6259	386	0.7590	0.5164	0.7590	0.8712
No log	2.6395	388	0.8793	0.5001	0.8793	0.9377
No log	2.6531	390	0.8644	0.5670	0.8644	0.9298
No log	2.6667	392	0.6896	0.5824	0.6896	0.8304
No log	2.6803	394	0.4798	0.5882	0.4798	0.6927
No log	2.6939	396	0.4047	0.5474	0.4047	0.6362
No log	2.7075	398	0.4482	0.5023	0.4482	0.6695
No log	2.7211	400	0.5095	0.4659	0.5095	0.7138
No log	2.7347	402	0.4497	0.4953	0.4497	0.6706
No log	2.7483	404	0.4068	0.5443	0.4068	0.6378
No log	2.7619	406	0.4891	0.5940	0.4891	0.6993
No log	2.7755	408	0.4502	0.5867	0.4502	0.6710
No log	2.7891	410	0.4084	0.5144	0.4084	0.6391
No log	2.8027	412	0.4161	0.4674	0.4161	0.6451
No log	2.8163	414	0.4594	0.4434	0.4594	0.6778
No log	2.8299	416	0.4783	0.4321	0.4783	0.6916
No log	2.8435	418	0.4352	0.4562	0.4352	0.6597
No log	2.8571	420	0.4204	0.4730	0.4204	0.6484
No log	2.8707	422	0.4471	0.5487	0.4471	0.6687
No log	2.8844	424	0.5164	0.5636	0.5164	0.7186
No log	2.8980	426	0.5355	0.5694	0.5355	0.7318
No log	2.9116	428	0.4730	0.5639	0.4730	0.6878
No log	2.9252	430	0.4213	0.5241	0.4213	0.6491
No log	2.9388	432	0.3995	0.5254	0.3995	0.6320
No log	2.9524	434	0.3976	0.5230	0.3976	0.6305
No log	2.9660	436	0.4494	0.5106	0.4494	0.6704
No log	2.9796	438	0.4789	0.4969	0.4789	0.6920
No log	2.9932	440	0.4505	0.5021	0.4505	0.6712
No log	3.0068	442	0.4136	0.5907	0.4136	0.6431
No log	3.0204	444	0.5026	0.6014	0.5026	0.7089
No log	3.0340	446	0.6926	0.5761	0.6926	0.8322
No log	3.0476	448	0.7703	0.5456	0.7703	0.8777
No log	3.0612	450	0.6891	0.5770	0.6891	0.8301
No log	3.0748	452	0.4895	0.5899	0.4895	0.6996
No log	3.0884	454	0.4083	0.5557	0.4083	0.6390
No log	3.1020	456	0.3953	0.5306	0.3953	0.6288
No log	3.1156	458	0.4103	0.5007	0.4103	0.6406
No log	3.1293	460	0.4311	0.4869	0.4311	0.6566
No log	3.1429	462	0.4025	0.4979	0.4025	0.6345
No log	3.1565	464	0.4047	0.5345	0.4047	0.6361
No log	3.1701	466	0.4262	0.5513	0.4262	0.6528
No log	3.1837	468	0.4543	0.5598	0.4543	0.6740
No log	3.1973	470	0.4536	0.5452	0.4536	0.6735
No log	3.2109	472	0.4332	0.5160	0.4332	0.6581
No log	3.2245	474	0.4225	0.4971	0.4225	0.6500
No log	3.2381	476	0.4249	0.4602	0.4249	0.6519
No log	3.2517	478	0.4262	0.4671	0.4262	0.6528
No log	3.2653	480	0.4204	0.4729	0.4204	0.6484
No log	3.2789	482	0.4026	0.5116	0.4026	0.6345
No log	3.2925	484	0.4008	0.5632	0.4008	0.6331
No log	3.3061	486	0.4879	0.6039	0.4879	0.6985
No log	3.3197	488	0.5552	0.5950	0.5552	0.7451
No log	3.3333	490	0.5282	0.5899	0.5282	0.7268
No log	3.3469	492	0.4506	0.5973	0.4506	0.6713
No log	3.3605	494	0.4266	0.5973	0.4266	0.6532
No log	3.3741	496	0.4276	0.5965	0.4276	0.6539
No log	3.3878	498	0.4342	0.6065	0.4342	0.6589
1.3105	3.4014	500	0.4678	0.6013	0.4678	0.6840
1.3105	3.4150	502	0.5137	0.6204	0.5137	0.7167
1.3105	3.4286	504	0.5254	0.6163	0.5254	0.7249
1.3105	3.4422	506	0.4974	0.6221	0.4974	0.7053
1.3105	3.4558	508	0.4281	0.6223	0.4281	0.6543
1.3105	3.4694	510	0.4056	0.6136	0.4056	0.6369
1.3105	3.4830	512	0.3950	0.6175	0.3950	0.6285
1.3105	3.4966	514	0.4145	0.6276	0.4145	0.6438
1.3105	3.5102	516	0.3973	0.6272	0.3973	0.6303
1.3105	3.5238	518	0.3771	0.5869	0.3771	0.6141
1.3105	3.5374	520	0.3814	0.5469	0.3814	0.6176
1.3105	3.5510	522	0.3817	0.5434	0.3817	0.6178
1.3105	3.5646	524	0.3763	0.5823	0.3763	0.6134
1.3105	3.5782	526	0.4382	0.6137	0.4382	0.6620
1.3105	3.5918	528	0.5654	0.6140	0.5654	0.7520
1.3105	3.6054	530	0.6788	0.5814	0.6788	0.8239
1.3105	3.6190	532	0.7106	0.5694	0.7106	0.8430
1.3105	3.6327	534	0.6586	0.5676	0.6586	0.8115
1.3105	3.6463	536	0.5884	0.5820	0.5884	0.7670
1.3105	3.6599	538	0.4759	0.5818	0.4759	0.6899

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1