ASAP_FineTuningBERT_AugV4_k3_task1_organization_fold0

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5008
• Qwk: 0.6069
• Mse: 0.5008
• Rmse: 0.7076

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0063	2	9.8014	0.0036	9.8014	3.1307
No log	0.0125	4	8.3909	0.0	8.3909	2.8967
No log	0.0188	6	7.4352	0.0	7.4352	2.7268
No log	0.0251	8	6.6641	0.0	6.6641	2.5815
No log	0.0313	10	5.9983	-0.0031	5.9983	2.4491
No log	0.0376	12	5.1412	0.0112	5.1412	2.2674
No log	0.0439	14	4.3654	0.0077	4.3654	2.0893
No log	0.0502	16	3.6340	0.0039	3.6340	1.9063
No log	0.0564	18	2.9561	0.0	2.9561	1.7193
No log	0.0627	20	2.3287	0.0943	2.3287	1.5260
No log	0.0690	22	1.8074	0.0382	1.8074	1.3444
No log	0.0752	24	1.3717	0.0316	1.3717	1.1712
No log	0.0815	26	1.0810	0.0316	1.0810	1.0397
No log	0.0878	28	0.9083	0.0212	0.9083	0.9530
No log	0.0940	30	0.7941	0.1726	0.7941	0.8911
No log	0.1003	32	0.7662	0.0968	0.7662	0.8753
No log	0.1066	34	0.7216	0.1383	0.7216	0.8495
No log	0.1129	36	0.8502	0.0689	0.8502	0.9221
No log	0.1191	38	0.8337	0.0689	0.8337	0.9131
No log	0.1254	40	0.7590	0.0968	0.7590	0.8712
No log	0.1317	42	0.8502	0.0689	0.8502	0.9221
No log	0.1379	44	0.6821	0.1076	0.6821	0.8259
No log	0.1442	46	0.6543	0.1428	0.6543	0.8089
No log	0.1505	48	0.6665	0.3631	0.6665	0.8164
No log	0.1567	50	0.6695	0.1184	0.6695	0.8182
No log	0.1630	52	1.0699	0.3511	1.0699	1.0344
No log	0.1693	54	1.1597	0.2848	1.1597	1.0769
No log	0.1755	56	0.7832	0.1521	0.7832	0.8850
No log	0.1818	58	0.6326	0.2976	0.6326	0.7954
No log	0.1881	60	0.6150	0.2263	0.6150	0.7842
No log	0.1944	62	0.7001	0.1541	0.7001	0.8367
No log	0.2006	64	0.9949	0.3741	0.9949	0.9974
No log	0.2069	66	0.9355	0.0968	0.9355	0.9672
No log	0.2132	68	0.7370	0.1450	0.7370	0.8585
No log	0.2194	70	0.6837	0.1751	0.6837	0.8269
No log	0.2257	72	0.5973	0.2134	0.5973	0.7729
No log	0.2320	74	0.6704	0.1795	0.6704	0.8188
No log	0.2382	76	0.5843	0.2348	0.5843	0.7644
No log	0.2445	78	0.5533	0.2999	0.5533	0.7438
No log	0.2508	80	0.5054	0.4532	0.5054	0.7109
No log	0.2571	82	0.4906	0.4907	0.4906	0.7004
No log	0.2633	84	0.4614	0.5079	0.4614	0.6793
No log	0.2696	86	0.4771	0.5168	0.4771	0.6907
No log	0.2759	88	0.4620	0.4945	0.4620	0.6797
No log	0.2821	90	0.5134	0.4851	0.5134	0.7165
No log	0.2884	92	0.5279	0.5742	0.5279	0.7265
No log	0.2947	94	0.6482	0.4733	0.6482	0.8051
No log	0.3009	96	0.5407	0.5499	0.5407	0.7353
No log	0.3072	98	0.5539	0.5510	0.5539	0.7442
No log	0.3135	100	0.5776	0.5346	0.5776	0.7600
No log	0.3197	102	0.5751	0.5508	0.5751	0.7584
No log	0.3260	104	0.5938	0.5675	0.5938	0.7706
No log	0.3323	106	0.5858	0.5580	0.5858	0.7654
No log	0.3386	108	0.5616	0.5738	0.5616	0.7494
No log	0.3448	110	0.6132	0.5515	0.6132	0.7831
No log	0.3511	112	0.6075	0.5341	0.6075	0.7794
No log	0.3574	114	0.5396	0.5942	0.5396	0.7346
No log	0.3636	116	0.8483	0.3672	0.8483	0.9211
No log	0.3699	118	0.8047	0.3936	0.8047	0.8970
No log	0.3762	120	0.5247	0.5679	0.5247	0.7244
No log	0.3824	122	0.5508	0.4856	0.5508	0.7422
No log	0.3887	124	0.5180	0.5341	0.5180	0.7197
No log	0.3950	126	0.7539	0.4131	0.7539	0.8683
No log	0.4013	128	0.8271	0.3751	0.8271	0.9095
No log	0.4075	130	0.5827	0.4983	0.5827	0.7633
No log	0.4138	132	0.5191	0.5210	0.5191	0.7205
No log	0.4201	134	0.5157	0.5351	0.5157	0.7181
No log	0.4263	136	0.6915	0.4723	0.6915	0.8316
No log	0.4326	138	0.7982	0.4204	0.7982	0.8934
No log	0.4389	140	0.6250	0.5157	0.6250	0.7906
No log	0.4451	142	0.5110	0.5263	0.5110	0.7148
No log	0.4514	144	0.5672	0.4639	0.5672	0.7531
No log	0.4577	146	0.5313	0.5168	0.5313	0.7289
No log	0.4639	148	0.5762	0.5336	0.5762	0.7591
No log	0.4702	150	0.7528	0.4311	0.7528	0.8676
No log	0.4765	152	0.7874	0.4161	0.7874	0.8874
No log	0.4828	154	0.6125	0.4872	0.6125	0.7826
No log	0.4890	156	0.5570	0.5109	0.5570	0.7463
No log	0.4953	158	0.5586	0.4925	0.5586	0.7474
No log	0.5016	160	0.5454	0.5315	0.5454	0.7385
No log	0.5078	162	0.5624	0.5527	0.5624	0.7499
No log	0.5141	164	0.5993	0.5450	0.5993	0.7742
No log	0.5204	166	0.6087	0.5616	0.6087	0.7802
No log	0.5266	168	0.7447	0.5472	0.7447	0.8629
No log	0.5329	170	1.1317	0.4133	1.1317	1.0638
No log	0.5392	172	1.0004	0.4386	1.0004	1.0002
No log	0.5455	174	0.7299	0.5171	0.7299	0.8544
No log	0.5517	176	0.6211	0.5231	0.6211	0.7881
No log	0.5580	178	0.5945	0.5033	0.5945	0.7710
No log	0.5643	180	0.5943	0.4819	0.5943	0.7709
No log	0.5705	182	0.6199	0.4195	0.6199	0.7874
No log	0.5768	184	0.5583	0.5053	0.5583	0.7472
No log	0.5831	186	0.5554	0.5152	0.5554	0.7453
No log	0.5893	188	0.6009	0.5452	0.6009	0.7752
No log	0.5956	190	0.5779	0.5472	0.5779	0.7602
No log	0.6019	192	0.5076	0.5539	0.5076	0.7125
No log	0.6082	194	0.5403	0.5199	0.5403	0.7351
No log	0.6144	196	0.4971	0.5220	0.4971	0.7051
No log	0.6207	198	0.6000	0.5148	0.6000	0.7746
No log	0.6270	200	1.0451	0.3550	1.0451	1.0223
No log	0.6332	202	1.0723	0.3430	1.0723	1.0355
No log	0.6395	204	0.6871	0.5044	0.6871	0.8289
No log	0.6458	206	0.5207	0.5477	0.5207	0.7216
No log	0.6520	208	0.5375	0.5333	0.5375	0.7331
No log	0.6583	210	0.7185	0.4852	0.7185	0.8477
No log	0.6646	212	1.1143	0.3105	1.1143	1.0556
No log	0.6708	214	1.1428	0.2932	1.1428	1.0690
No log	0.6771	216	0.8488	0.4198	0.8488	0.9213
No log	0.6834	218	0.5125	0.5855	0.5125	0.7159
No log	0.6897	220	0.4879	0.5295	0.4879	0.6985
No log	0.6959	222	0.5013	0.5716	0.5013	0.7080
No log	0.7022	224	0.6301	0.5114	0.6301	0.7938
No log	0.7085	226	0.6603	0.4937	0.6603	0.8126
No log	0.7147	228	0.5766	0.5149	0.5766	0.7593
No log	0.7210	230	0.5159	0.5381	0.5159	0.7182
No log	0.7273	232	0.4995	0.5383	0.4995	0.7068
No log	0.7335	234	0.5079	0.5545	0.5079	0.7126
No log	0.7398	236	0.5893	0.5239	0.5893	0.7677
No log	0.7461	238	0.6276	0.5185	0.6276	0.7922
No log	0.7524	240	0.5841	0.5421	0.5841	0.7643
No log	0.7586	242	0.5674	0.5339	0.5674	0.7532
No log	0.7649	244	0.5754	0.5069	0.5754	0.7586
No log	0.7712	246	0.6261	0.5236	0.6261	0.7913
No log	0.7774	248	0.6046	0.5150	0.6046	0.7775
No log	0.7837	250	0.5631	0.4755	0.5631	0.7504
No log	0.7900	252	0.5555	0.4600	0.5555	0.7453
No log	0.7962	254	0.6681	0.4727	0.6681	0.8174
No log	0.8025	256	0.9899	0.4131	0.9899	0.9949
No log	0.8088	258	0.9181	0.4658	0.9181	0.9582
No log	0.8150	260	0.5782	0.5682	0.5782	0.7604
No log	0.8213	262	0.4872	0.5876	0.4872	0.6980
No log	0.8276	264	0.5219	0.5712	0.5219	0.7224
No log	0.8339	266	0.6977	0.4901	0.6977	0.8353
No log	0.8401	268	0.7466	0.4824	0.7466	0.8641
No log	0.8464	270	0.6029	0.5481	0.6029	0.7764
No log	0.8527	272	0.5285	0.5923	0.5285	0.7270
No log	0.8589	274	0.5256	0.6070	0.5256	0.7250
No log	0.8652	276	0.6003	0.5864	0.6003	0.7748
No log	0.8715	278	0.7241	0.5341	0.7241	0.8509
No log	0.8777	280	0.6580	0.5696	0.6580	0.8112
No log	0.8840	282	0.5418	0.6420	0.5418	0.7361
No log	0.8903	284	0.5818	0.5845	0.5818	0.7627
No log	0.8966	286	0.5897	0.5725	0.5897	0.7679
No log	0.9028	288	0.5107	0.6412	0.5107	0.7146
No log	0.9091	290	0.5344	0.6118	0.5344	0.7310
No log	0.9154	292	0.5175	0.6128	0.5175	0.7194
No log	0.9216	294	0.5031	0.5857	0.5031	0.7093
No log	0.9279	296	0.5226	0.5612	0.5226	0.7229
No log	0.9342	298	0.4973	0.5567	0.4973	0.7052
No log	0.9404	300	0.6137	0.5673	0.6137	0.7834
No log	0.9467	302	0.6031	0.5641	0.6031	0.7766
No log	0.9530	304	0.5597	0.5404	0.5597	0.7482
No log	0.9592	306	0.6046	0.5383	0.6046	0.7776
No log	0.9655	308	0.5641	0.5416	0.5641	0.7511
No log	0.9718	310	0.5244	0.5637	0.5244	0.7242
No log	0.9781	312	0.5265	0.5694	0.5265	0.7256
No log	0.9843	314	0.5538	0.5619	0.5538	0.7442
No log	0.9906	316	0.6290	0.5569	0.6290	0.7931
No log	0.9969	318	0.7878	0.4985	0.7878	0.8876
No log	1.0031	320	0.7957	0.4986	0.7957	0.8920
No log	1.0094	322	0.5951	0.5604	0.5951	0.7714
No log	1.0157	324	0.5367	0.5992	0.5367	0.7326
No log	1.0219	326	0.5687	0.5750	0.5687	0.7541
No log	1.0282	328	0.5455	0.6047	0.5455	0.7386
No log	1.0345	330	0.5639	0.6077	0.5639	0.7509
No log	1.0408	332	0.4738	0.6086	0.4738	0.6883
No log	1.0470	334	0.4675	0.6236	0.4675	0.6838
No log	1.0533	336	0.5233	0.6213	0.5233	0.7234
No log	1.0596	338	0.7116	0.5717	0.7116	0.8436
No log	1.0658	340	0.6246	0.5925	0.6246	0.7903
No log	1.0721	342	0.5036	0.6223	0.5036	0.7097
No log	1.0784	344	0.4977	0.6075	0.4977	0.7054
No log	1.0846	346	0.5473	0.6048	0.5473	0.7398
No log	1.0909	348	0.5220	0.6120	0.5220	0.7225
No log	1.0972	350	0.5038	0.6298	0.5038	0.7098
No log	1.1034	352	0.4878	0.5988	0.4878	0.6984
No log	1.1097	354	0.5014	0.6150	0.5014	0.7081
No log	1.1160	356	0.5713	0.5913	0.5713	0.7559
No log	1.1223	358	0.6025	0.5946	0.6025	0.7762
No log	1.1285	360	0.6905	0.5602	0.6905	0.8310
No log	1.1348	362	0.6694	0.5777	0.6694	0.8182
No log	1.1411	364	0.5992	0.6267	0.5992	0.7741
No log	1.1473	366	0.5697	0.6198	0.5697	0.7548
No log	1.1536	368	0.5819	0.6271	0.5819	0.7628
No log	1.1599	370	0.5758	0.6343	0.5758	0.7588
No log	1.1661	372	0.5237	0.6300	0.5237	0.7236
No log	1.1724	374	0.5448	0.5872	0.5448	0.7381
No log	1.1787	376	0.5282	0.5833	0.5282	0.7268
No log	1.1850	378	0.4755	0.6157	0.4755	0.6896
No log	1.1912	380	0.6213	0.5798	0.6213	0.7882
No log	1.1975	382	0.6168	0.5556	0.6168	0.7854
No log	1.2038	384	0.4974	0.5831	0.4974	0.7053
No log	1.2100	386	0.5146	0.5806	0.5146	0.7173
No log	1.2163	388	0.5231	0.5790	0.5231	0.7232
No log	1.2226	390	0.5885	0.5512	0.5885	0.7672
No log	1.2288	392	0.6517	0.5538	0.6517	0.8073
No log	1.2351	394	0.5481	0.5877	0.5481	0.7403
No log	1.2414	396	0.5262	0.5692	0.5262	0.7254
No log	1.2476	398	0.5350	0.5843	0.5350	0.7314
No log	1.2539	400	0.5839	0.5802	0.5839	0.7641
No log	1.2602	402	0.5497	0.6198	0.5497	0.7414
No log	1.2665	404	0.5661	0.6147	0.5661	0.7524
No log	1.2727	406	0.6145	0.5936	0.6145	0.7839
No log	1.2790	408	0.5705	0.5968	0.5705	0.7553
No log	1.2853	410	0.5404	0.5922	0.5404	0.7351
No log	1.2915	412	0.5280	0.5804	0.5280	0.7266
No log	1.2978	414	0.5522	0.5687	0.5522	0.7431
No log	1.3041	416	0.5756	0.5773	0.5756	0.7587
No log	1.3103	418	0.5348	0.5812	0.5348	0.7313
No log	1.3166	420	0.5500	0.6004	0.5500	0.7416
No log	1.3229	422	0.5272	0.6065	0.5272	0.7261
No log	1.3292	424	0.5529	0.6237	0.5529	0.7436
No log	1.3354	426	0.5564	0.6317	0.5564	0.7459
No log	1.3417	428	0.5736	0.6188	0.5736	0.7574
No log	1.3480	430	0.5683	0.6209	0.5683	0.7539
No log	1.3542	432	0.5728	0.6001	0.5728	0.7568
No log	1.3605	434	0.5268	0.6483	0.5268	0.7258
No log	1.3668	436	0.5242	0.6313	0.5242	0.7240
No log	1.3730	438	0.5406	0.6073	0.5406	0.7352
No log	1.3793	440	0.5635	0.5778	0.5635	0.7507
No log	1.3856	442	0.6444	0.5532	0.6444	0.8028
No log	1.3918	444	0.7691	0.4933	0.7691	0.8770
No log	1.3981	446	0.6863	0.5138	0.6863	0.8284
No log	1.4044	448	0.6033	0.5425	0.6033	0.7767
No log	1.4107	450	0.5834	0.5557	0.5834	0.7638
No log	1.4169	452	0.7365	0.4837	0.7365	0.8582
No log	1.4232	454	0.8629	0.4697	0.8629	0.9289
No log	1.4295	456	0.6535	0.5361	0.6535	0.8084
No log	1.4357	458	0.5265	0.5620	0.5265	0.7256
No log	1.4420	460	0.6353	0.4856	0.6353	0.7971
No log	1.4483	462	0.5827	0.4931	0.5827	0.7634
No log	1.4545	464	0.5158	0.5642	0.5158	0.7182
No log	1.4608	466	0.7285	0.5226	0.7285	0.8535
No log	1.4671	468	0.7093	0.5237	0.7093	0.8422
No log	1.4734	470	0.5262	0.5581	0.5262	0.7254
No log	1.4796	472	0.5229	0.5556	0.5229	0.7231
No log	1.4859	474	0.5168	0.5617	0.5168	0.7189
No log	1.4922	476	0.5213	0.5603	0.5213	0.7220
No log	1.4984	478	0.5480	0.5431	0.5480	0.7403
No log	1.5047	480	0.5385	0.5437	0.5385	0.7338
No log	1.5110	482	0.5824	0.5503	0.5824	0.7631
No log	1.5172	484	0.5532	0.5358	0.5532	0.7438
No log	1.5235	486	0.5568	0.5573	0.5568	0.7462
No log	1.5298	488	0.5812	0.5595	0.5812	0.7624
No log	1.5361	490	0.5776	0.5810	0.5776	0.7600
No log	1.5423	492	0.6020	0.5813	0.6020	0.7759
No log	1.5486	494	0.5278	0.6173	0.5278	0.7265
No log	1.5549	496	0.5174	0.6106	0.5174	0.7193
No log	1.5611	498	0.5245	0.6364	0.5245	0.7242
0.9339	1.5674	500	0.5015	0.6202	0.5015	0.7082
0.9339	1.5737	502	0.5029	0.6187	0.5029	0.7092
0.9339	1.5799	504	0.5657	0.5740	0.5657	0.7521
0.9339	1.5862	506	0.6156	0.5661	0.6156	0.7846
0.9339	1.5925	508	0.5991	0.5598	0.5991	0.7740
0.9339	1.5987	510	0.5008	0.6069	0.5008	0.7076

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1