ASAP_FineTuningBERT_Aug_k35_task1_organization_fold0

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5351
• Qwk: 0.5254
• Mse: 0.5351
• Rmse: 0.7315

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0038	2	9.7816	0.0	9.7816	3.1276
No log	0.0075	4	8.2519	0.0132	8.2519	2.8726
No log	0.0113	6	7.2520	0.0051	7.2520	2.6929
No log	0.0151	8	6.4845	0.0018	6.4845	2.5465
No log	0.0189	10	5.6501	0.0	5.6501	2.3770
No log	0.0226	12	4.8220	0.0	4.8220	2.1959
No log	0.0264	14	4.0232	0.0454	4.0232	2.0058
No log	0.0302	16	3.2367	0.0150	3.2367	1.7991
No log	0.0340	18	2.5450	0.0115	2.5450	1.5953
No log	0.0377	20	1.9899	0.0077	1.9899	1.4106
No log	0.0415	22	1.5286	0.0087	1.5286	1.2364
No log	0.0453	24	1.2087	0.0870	1.2087	1.0994
No log	0.0491	26	0.9887	0.0646	0.9887	0.9943
No log	0.0528	28	0.8246	0.0316	0.8246	0.9081
No log	0.0566	30	0.8164	0.0316	0.8164	0.9036
No log	0.0604	32	0.8047	0.0212	0.8047	0.8971
No log	0.0642	34	0.7954	0.0212	0.7954	0.8919
No log	0.0679	36	0.8377	0.0106	0.8377	0.9152
No log	0.0717	38	0.7772	0.0106	0.7772	0.8816
No log	0.0755	40	0.7781	0.0076	0.7781	0.8821
No log	0.0792	42	0.7716	0.0316	0.7716	0.8784
No log	0.0830	44	0.7671	0.0316	0.7671	0.8759
No log	0.0868	46	0.7863	0.0316	0.7863	0.8867
No log	0.0906	48	0.7558	0.0316	0.7558	0.8694
No log	0.0943	50	0.7571	0.0106	0.7571	0.8701
No log	0.0981	52	0.8010	0.0316	0.8010	0.8950
No log	0.1019	54	0.8386	0.0316	0.8386	0.9158
No log	0.1057	56	0.7957	0.0106	0.7957	0.8920
No log	0.1094	58	0.8150	0.0106	0.8150	0.9028
No log	0.1132	60	0.8158	0.0106	0.8158	0.9032
No log	0.1170	62	0.8104	0.0106	0.8104	0.9002
No log	0.1208	64	0.8187	0.0	0.8187	0.9048
No log	0.1245	66	0.9072	0.0	0.9072	0.9525
No log	0.1283	68	0.8988	0.0	0.8988	0.9481
No log	0.1321	70	0.7943	0.0106	0.7943	0.8912
No log	0.1358	72	0.7862	0.0106	0.7862	0.8867
No log	0.1396	74	0.7809	0.0106	0.7809	0.8837
No log	0.1434	76	0.7612	0.0106	0.7612	0.8725
No log	0.1472	78	0.7625	0.0106	0.7625	0.8732
No log	0.1509	80	0.7665	0.0106	0.7665	0.8755
No log	0.1547	82	0.7845	0.0106	0.7845	0.8857
No log	0.1585	84	0.8464	0.0106	0.8464	0.9200
No log	0.1623	86	0.8892	0.0	0.8892	0.9430
No log	0.1660	88	0.8508	0.0	0.8508	0.9224
No log	0.1698	90	0.7709	0.0	0.7709	0.8780
No log	0.1736	92	0.7608	0.0	0.7608	0.8722
No log	0.1774	94	0.7666	0.0	0.7666	0.8756
No log	0.1811	96	0.7819	0.0	0.7819	0.8842
No log	0.1849	98	0.7780	0.0106	0.7780	0.8821
No log	0.1887	100	0.7442	0.0106	0.7442	0.8627
No log	0.1925	102	0.7480	0.0106	0.7480	0.8649
No log	0.1962	104	0.7258	0.0106	0.7258	0.8520
No log	0.2	106	0.7244	0.0106	0.7244	0.8511
No log	0.2038	108	0.7347	0.0	0.7347	0.8572
No log	0.2075	110	0.7476	0.0	0.7476	0.8647
No log	0.2113	112	0.7162	0.0400	0.7162	0.8463
No log	0.2151	114	0.7013	0.1190	0.7013	0.8375
No log	0.2189	116	0.7111	0.1140	0.7111	0.8433
No log	0.2226	118	0.7134	0.0272	0.7134	0.8446
No log	0.2264	120	0.7127	0.1445	0.7127	0.8442
No log	0.2302	122	0.7288	0.2521	0.7288	0.8537
No log	0.2340	124	0.7186	0.1185	0.7186	0.8477
No log	0.2377	126	0.7296	0.0161	0.7296	0.8542
No log	0.2415	128	0.7417	0.0106	0.7417	0.8612
No log	0.2453	130	0.7054	0.0527	0.7054	0.8399
No log	0.2491	132	0.7183	0.2470	0.7183	0.8475
No log	0.2528	134	0.7048	0.2178	0.7048	0.8395
No log	0.2566	136	0.7016	0.0973	0.7016	0.8376
No log	0.2604	138	0.7318	0.0	0.7318	0.8555
No log	0.2642	140	0.7041	0.0439	0.7041	0.8391
No log	0.2679	142	0.6936	0.2278	0.6936	0.8328
No log	0.2717	144	0.6985	0.1546	0.6985	0.8358
No log	0.2755	146	0.7032	0.0668	0.7032	0.8386
No log	0.2792	148	0.6623	0.1421	0.6623	0.8138
No log	0.2830	150	0.6608	0.0719	0.6608	0.8129
No log	0.2868	152	0.6581	0.0832	0.6581	0.8112
No log	0.2906	154	0.6415	0.0755	0.6415	0.8009
No log	0.2943	156	0.6582	0.0593	0.6582	0.8113
No log	0.2981	158	0.6471	0.2568	0.6471	0.8044
No log	0.3019	160	0.6477	0.2382	0.6477	0.8048
No log	0.3057	162	0.6576	0.2970	0.6576	0.8109
No log	0.3094	164	0.6648	0.3346	0.6648	0.8154
No log	0.3132	166	0.6346	0.2640	0.6346	0.7966
No log	0.3170	168	0.6191	0.2991	0.6191	0.7868
No log	0.3208	170	0.6079	0.2982	0.6079	0.7797
No log	0.3245	172	0.6261	0.1946	0.6261	0.7913
No log	0.3283	174	0.6028	0.3025	0.6028	0.7764
No log	0.3321	176	0.6200	0.3847	0.6200	0.7874
No log	0.3358	178	0.6544	0.3900	0.6544	0.8089
No log	0.3396	180	0.6403	0.3809	0.6403	0.8002
No log	0.3434	182	0.6049	0.3866	0.6049	0.7778
No log	0.3472	184	0.6059	0.4112	0.6059	0.7784
No log	0.3509	186	0.6274	0.4514	0.6274	0.7921
No log	0.3547	188	0.5838	0.2817	0.5838	0.7641
No log	0.3585	190	0.5916	0.2609	0.5916	0.7692
No log	0.3623	192	0.6141	0.4232	0.6141	0.7837
No log	0.3660	194	0.6117	0.3366	0.6117	0.7821
No log	0.3698	196	0.6159	0.3102	0.6159	0.7848
No log	0.3736	198	0.6221	0.3831	0.6221	0.7887
No log	0.3774	200	0.6208	0.3615	0.6208	0.7879
No log	0.3811	202	0.6163	0.1554	0.6163	0.7851
No log	0.3849	204	0.6693	0.0780	0.6693	0.8181
No log	0.3887	206	0.6294	0.1078	0.6294	0.7934
No log	0.3925	208	0.6480	0.3479	0.6480	0.8050
No log	0.3962	210	0.6549	0.1753	0.6549	0.8093
No log	0.4	212	0.6696	0.0672	0.6696	0.8183
No log	0.4038	214	0.6876	0.0636	0.6876	0.8292
No log	0.4075	216	0.5859	0.2068	0.5859	0.7655
No log	0.4113	218	0.5851	0.5004	0.5851	0.7649
No log	0.4151	220	0.6383	0.4698	0.6383	0.7989
No log	0.4189	222	0.6001	0.4792	0.6001	0.7747
No log	0.4226	224	0.6086	0.4408	0.6086	0.7801
No log	0.4264	226	0.6757	0.3149	0.6757	0.8220
No log	0.4302	228	0.6776	0.3428	0.6776	0.8231
No log	0.4340	230	0.6088	0.3396	0.6088	0.7802
No log	0.4377	232	0.5812	0.1958	0.5812	0.7624
No log	0.4415	234	0.5517	0.2853	0.5517	0.7428
No log	0.4453	236	0.5701	0.4736	0.5701	0.7551
No log	0.4491	238	0.5883	0.4782	0.5883	0.7670
No log	0.4528	240	0.5655	0.4345	0.5655	0.7520
No log	0.4566	242	0.5601	0.3447	0.5601	0.7484
No log	0.4604	244	0.5711	0.3661	0.5711	0.7557
No log	0.4642	246	0.6400	0.4351	0.6400	0.8000
No log	0.4679	248	0.6662	0.4235	0.6662	0.8162
No log	0.4717	250	0.5808	0.4254	0.5808	0.7621
No log	0.4755	252	0.5986	0.1430	0.5986	0.7737
No log	0.4792	254	0.6115	0.1383	0.6115	0.7820
No log	0.4830	256	0.5784	0.3234	0.5784	0.7605
No log	0.4868	258	0.6502	0.4552	0.6502	0.8064
No log	0.4906	260	0.6439	0.4363	0.6439	0.8024
No log	0.4943	262	0.5802	0.3938	0.5802	0.7617
No log	0.4981	264	0.5775	0.2271	0.5775	0.7599
No log	0.5019	266	0.5490	0.3062	0.5490	0.7410
No log	0.5057	268	0.5582	0.4382	0.5582	0.7472
No log	0.5094	270	0.6048	0.4604	0.6048	0.7777
No log	0.5132	272	0.6074	0.4468	0.6074	0.7794
No log	0.5170	274	0.6077	0.4164	0.6077	0.7796
No log	0.5208	276	0.6505	0.4149	0.6505	0.8065
No log	0.5245	278	0.7391	0.3987	0.7391	0.8597
No log	0.5283	280	0.7040	0.4114	0.7040	0.8390
No log	0.5321	282	0.5785	0.4146	0.5785	0.7606
No log	0.5358	284	0.5707	0.3619	0.5707	0.7554
No log	0.5396	286	0.6069	0.4529	0.6069	0.7790
No log	0.5434	288	0.6282	0.4509	0.6282	0.7926
No log	0.5472	290	0.6048	0.4388	0.6048	0.7777
No log	0.5509	292	0.6382	0.4369	0.6382	0.7989
No log	0.5547	294	0.5812	0.4592	0.5812	0.7623
No log	0.5585	296	0.5603	0.4592	0.5603	0.7485
No log	0.5623	298	0.5962	0.4747	0.5962	0.7721
No log	0.5660	300	0.7214	0.4146	0.7214	0.8493
No log	0.5698	302	0.5892	0.4903	0.5892	0.7676
No log	0.5736	304	0.5000	0.4316	0.5000	0.7071
No log	0.5774	306	0.5181	0.3521	0.5181	0.7198
No log	0.5811	308	0.5165	0.4362	0.5165	0.7187
No log	0.5849	310	0.5651	0.4756	0.5651	0.7517
No log	0.5887	312	0.6032	0.4645	0.6032	0.7767
No log	0.5925	314	0.5294	0.5065	0.5294	0.7276
No log	0.5962	316	0.4640	0.4911	0.4640	0.6812
No log	0.6	318	0.4561	0.5137	0.4561	0.6754
No log	0.6038	320	0.4372	0.5189	0.4372	0.6612
No log	0.6075	322	0.4688	0.4486	0.4688	0.6847
No log	0.6113	324	0.4415	0.4774	0.4415	0.6644
No log	0.6151	326	0.4630	0.5035	0.4630	0.6804
No log	0.6189	328	0.5129	0.5299	0.5129	0.7161
No log	0.6226	330	0.4757	0.4228	0.4757	0.6897
No log	0.6264	332	0.5425	0.2978	0.5425	0.7365
No log	0.6302	334	0.5023	0.3565	0.5023	0.7087
No log	0.6340	336	0.4928	0.4804	0.4928	0.7020
No log	0.6377	338	0.4822	0.4200	0.4822	0.6944
No log	0.6415	340	0.5244	0.3164	0.5244	0.7241
No log	0.6453	342	0.5332	0.3182	0.5332	0.7302
No log	0.6491	344	0.4630	0.4661	0.4630	0.6804
No log	0.6528	346	0.6684	0.4938	0.6684	0.8176
No log	0.6566	348	0.6222	0.4876	0.6222	0.7888
No log	0.6604	350	0.4752	0.4526	0.4752	0.6894
No log	0.6642	352	0.5346	0.2868	0.5346	0.7311
No log	0.6679	354	0.5254	0.2966	0.5254	0.7249
No log	0.6717	356	0.5218	0.4417	0.5218	0.7224
No log	0.6755	358	0.6092	0.4725	0.6092	0.7805
No log	0.6792	360	0.5896	0.4775	0.5896	0.7679
No log	0.6830	362	0.5416	0.4620	0.5416	0.7359
No log	0.6868	364	0.5346	0.4651	0.5346	0.7312
No log	0.6906	366	0.5107	0.4559	0.5107	0.7147
No log	0.6943	368	0.5107	0.4605	0.5107	0.7146
No log	0.6981	370	0.5162	0.4469	0.5162	0.7185
No log	0.7019	372	0.5587	0.5093	0.5587	0.7475
No log	0.7057	374	0.5444	0.4899	0.5444	0.7378
No log	0.7094	376	0.5045	0.3914	0.5045	0.7103
No log	0.7132	378	0.5101	0.3384	0.5101	0.7142
No log	0.7170	380	0.5095	0.3913	0.5095	0.7138
No log	0.7208	382	0.5529	0.4649	0.5529	0.7436
No log	0.7245	384	0.5092	0.4446	0.5092	0.7136
No log	0.7283	386	0.4870	0.3874	0.4870	0.6978
No log	0.7321	388	0.4869	0.3835	0.4869	0.6978
No log	0.7358	390	0.4718	0.4790	0.4718	0.6869
No log	0.7396	392	0.5518	0.5051	0.5518	0.7429
No log	0.7434	394	0.5384	0.5257	0.5384	0.7337
No log	0.7472	396	0.4499	0.4814	0.4499	0.6707
No log	0.7509	398	0.5894	0.3288	0.5894	0.7677
No log	0.7547	400	0.5932	0.3238	0.5932	0.7702
No log	0.7585	402	0.4811	0.3903	0.4811	0.6936
No log	0.7623	404	0.5028	0.4867	0.5028	0.7091
No log	0.7660	406	0.5885	0.4829	0.5885	0.7671
No log	0.7698	408	0.5443	0.4865	0.5443	0.7378
No log	0.7736	410	0.4896	0.3708	0.4896	0.6997
No log	0.7774	412	0.6136	0.2270	0.6136	0.7833
No log	0.7811	414	0.6552	0.2103	0.6552	0.8094
No log	0.7849	416	0.5744	0.2410	0.5744	0.7579
No log	0.7887	418	0.5019	0.3669	0.5019	0.7084
No log	0.7925	420	0.5287	0.4993	0.5287	0.7271
No log	0.7962	422	0.5279	0.5230	0.5279	0.7266
No log	0.8	424	0.4563	0.4776	0.4563	0.6755
No log	0.8038	426	0.5081	0.3701	0.5081	0.7128
No log	0.8075	428	0.5115	0.3622	0.5115	0.7152
No log	0.8113	430	0.4529	0.4409	0.4529	0.6730
No log	0.8151	432	0.4905	0.5270	0.4905	0.7004
No log	0.8189	434	0.5053	0.5062	0.5053	0.7109
No log	0.8226	436	0.4566	0.4600	0.4566	0.6757
No log	0.8264	438	0.4643	0.4246	0.4643	0.6814
No log	0.8302	440	0.4605	0.4362	0.4605	0.6786
No log	0.8340	442	0.4689	0.5443	0.4689	0.6848
No log	0.8377	444	0.6962	0.4879	0.6962	0.8344
No log	0.8415	446	0.7045	0.4583	0.7045	0.8393
No log	0.8453	448	0.5197	0.5408	0.5197	0.7209
No log	0.8491	450	0.4811	0.4794	0.4811	0.6936
No log	0.8528	452	0.4976	0.4538	0.4976	0.7054
No log	0.8566	454	0.5050	0.4628	0.5050	0.7106
No log	0.8604	456	0.5760	0.5155	0.5760	0.7590
No log	0.8642	458	0.6076	0.5034	0.6076	0.7795
No log	0.8679	460	0.5062	0.5494	0.5062	0.7115
No log	0.8717	462	0.4456	0.5019	0.4456	0.6675
No log	0.8755	464	0.4391	0.5196	0.4391	0.6627
No log	0.8792	466	0.4541	0.5540	0.4541	0.6739
No log	0.8830	468	0.4336	0.5583	0.4336	0.6585
No log	0.8868	470	0.4249	0.4969	0.4249	0.6519
No log	0.8906	472	0.6162	0.3664	0.6162	0.7850
No log	0.8943	474	0.6842	0.3279	0.6842	0.8272
No log	0.8981	476	0.4780	0.4129	0.4780	0.6914
No log	0.9019	478	0.4569	0.5566	0.4569	0.6760
No log	0.9057	480	0.4996	0.5628	0.4996	0.7068
No log	0.9094	482	0.4464	0.5227	0.4464	0.6682
No log	0.9132	484	0.4444	0.4594	0.4444	0.6667
No log	0.9170	486	0.4440	0.5104	0.4440	0.6663
No log	0.9208	488	0.4822	0.5337	0.4822	0.6944
No log	0.9245	490	0.4928	0.5272	0.4928	0.7020
No log	0.9283	492	0.4745	0.5281	0.4745	0.6889
No log	0.9321	494	0.4789	0.5429	0.4789	0.6920
No log	0.9358	496	0.4606	0.5459	0.4606	0.6787
No log	0.9396	498	0.4478	0.5607	0.4478	0.6692
0.5317	0.9434	500	0.4800	0.5600	0.4800	0.6928
0.5317	0.9472	502	0.4288	0.5331	0.4288	0.6548
0.5317	0.9509	504	0.4307	0.5235	0.4307	0.6563
0.5317	0.9547	506	0.4846	0.5711	0.4846	0.6961
0.5317	0.9585	508	0.6884	0.5589	0.6884	0.8297
0.5317	0.9623	510	0.5738	0.5832	0.5738	0.7575
0.5317	0.9660	512	0.4560	0.4934	0.4560	0.6753
0.5317	0.9698	514	0.4975	0.3363	0.4975	0.7053
0.5317	0.9736	516	0.4998	0.3411	0.4998	0.7070
0.5317	0.9774	518	0.4740	0.4796	0.4740	0.6884
0.5317	0.9811	520	0.5351	0.5254	0.5351	0.7315

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1