ASAP_FineTuningBERT_AugV4_k4_task1_organization_fold4

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6215
• Qwk: 0.5835
• Mse: 0.6215
• Rmse: 0.7883

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0049	2	10.2024	0.0035	10.2024	3.1941
No log	0.0099	4	8.6111	0.0018	8.6111	2.9345
No log	0.0148	6	6.9434	0.0018	6.9434	2.6350
No log	0.0197	8	5.5076	0.0607	5.5076	2.3468
No log	0.0246	10	4.5662	0.0074	4.5662	2.1369
No log	0.0296	12	3.5615	0.0079	3.5615	1.8872
No log	0.0345	14	2.7900	0.0079	2.7900	1.6703
No log	0.0394	16	2.1974	0.1284	2.1974	1.4824
No log	0.0443	18	1.6442	0.0445	1.6442	1.2823
No log	0.0493	20	1.2816	0.0316	1.2816	1.1321
No log	0.0542	22	1.0325	0.0316	1.0325	1.0161
No log	0.0591	24	0.8507	0.3518	0.8507	0.9223
No log	0.0640	26	0.8325	0.1026	0.8325	0.9124
No log	0.0690	28	0.8790	0.0493	0.8790	0.9375
No log	0.0739	30	0.9754	0.0454	0.9754	0.9876
No log	0.0788	32	0.9975	0.0454	0.9975	0.9987
No log	0.0837	34	1.1711	0.0524	1.1711	1.0822
No log	0.0887	36	0.8027	0.1020	0.8027	0.8959
No log	0.0936	38	0.7554	0.1873	0.7554	0.8691
No log	0.0985	40	0.8249	0.0815	0.8249	0.9082
No log	0.1034	42	0.9253	0.0549	0.9253	0.9619
No log	0.1084	44	0.7558	0.1910	0.7558	0.8694
No log	0.1133	46	0.7422	0.2181	0.7422	0.8615
No log	0.1182	48	0.8660	0.0993	0.8660	0.9306
No log	0.1232	50	1.1622	0.2804	1.1622	1.0781
No log	0.1281	52	0.8938	0.2369	0.8938	0.9454
No log	0.1330	54	0.6613	0.3898	0.6613	0.8132
No log	0.1379	56	0.7145	0.4016	0.7145	0.8453
No log	0.1429	58	0.6071	0.3712	0.6071	0.7792
No log	0.1478	60	0.5986	0.3847	0.5986	0.7737
No log	0.1527	62	0.5716	0.4019	0.5716	0.7561
No log	0.1576	64	0.6156	0.4243	0.6156	0.7846
No log	0.1626	66	0.7946	0.4359	0.7946	0.8914
No log	0.1675	68	0.8161	0.4327	0.8161	0.9034
No log	0.1724	70	0.6451	0.4333	0.6451	0.8032
No log	0.1773	72	0.7140	0.4251	0.7140	0.8450
No log	0.1823	74	0.9974	0.3740	0.9974	0.9987
No log	0.1872	76	0.9087	0.3962	0.9087	0.9533
No log	0.1921	78	0.7836	0.4533	0.7836	0.8852
No log	0.1970	80	0.7285	0.4763	0.7285	0.8535
No log	0.2020	82	0.5527	0.4897	0.5527	0.7434
No log	0.2069	84	0.5552	0.5203	0.5552	0.7451
No log	0.2118	86	0.6267	0.4863	0.6267	0.7916
No log	0.2167	88	1.0184	0.3981	1.0184	1.0091
No log	0.2217	90	0.9069	0.4227	0.9069	0.9523
No log	0.2266	92	0.5708	0.5256	0.5708	0.7555
No log	0.2315	94	0.6862	0.3953	0.6862	0.8284
No log	0.2365	96	0.7177	0.3804	0.7177	0.8472
No log	0.2414	98	0.5391	0.5272	0.5391	0.7342
No log	0.2463	100	0.5296	0.5311	0.5296	0.7277
No log	0.2512	102	0.5360	0.5820	0.5360	0.7321
No log	0.2562	104	0.5280	0.5707	0.5280	0.7267
No log	0.2611	106	0.5192	0.5525	0.5192	0.7205
No log	0.2660	108	0.5556	0.5788	0.5556	0.7454
No log	0.2709	110	0.5838	0.5453	0.5838	0.7641
No log	0.2759	112	0.6717	0.5195	0.6717	0.8196
No log	0.2808	114	0.8962	0.4468	0.8962	0.9467
No log	0.2857	116	1.1372	0.3628	1.1372	1.0664
No log	0.2906	118	0.9467	0.4496	0.9467	0.9730
No log	0.2956	120	0.6575	0.4989	0.6575	0.8108
No log	0.3005	122	0.6981	0.5134	0.6981	0.8355
No log	0.3054	124	0.9383	0.4587	0.9383	0.9687
No log	0.3103	126	0.9933	0.4196	0.9933	0.9966
No log	0.3153	128	0.6477	0.4793	0.6477	0.8048
No log	0.3202	130	0.5635	0.4768	0.5635	0.7507
No log	0.3251	132	0.5558	0.5039	0.5558	0.7455
No log	0.3300	134	0.7659	0.4872	0.7659	0.8751
No log	0.3350	136	0.7660	0.4930	0.7660	0.8752
No log	0.3399	138	0.5414	0.5581	0.5414	0.7358
No log	0.3448	140	0.5147	0.5692	0.5147	0.7174
No log	0.3498	142	0.5337	0.5498	0.5337	0.7305
No log	0.3547	144	0.5214	0.5657	0.5214	0.7221
No log	0.3596	146	0.5495	0.5751	0.5495	0.7413
No log	0.3645	148	0.5478	0.5611	0.5478	0.7401
No log	0.3695	150	0.6485	0.5407	0.6485	0.8053
No log	0.3744	152	0.6751	0.5224	0.6751	0.8216
No log	0.3793	154	0.8339	0.4949	0.8339	0.9132
No log	0.3842	156	0.8045	0.4923	0.8045	0.8970
No log	0.3892	158	0.7684	0.4719	0.7684	0.8766
No log	0.3941	160	0.6264	0.5153	0.6264	0.7915
No log	0.3990	162	0.5496	0.5114	0.5496	0.7413
No log	0.4039	164	0.5544	0.5290	0.5544	0.7446
No log	0.4089	166	0.6284	0.5203	0.6284	0.7927
No log	0.4138	168	0.7093	0.5138	0.7093	0.8422
No log	0.4187	170	0.6742	0.5245	0.6742	0.8211
No log	0.4236	172	0.5290	0.5628	0.5290	0.7273
No log	0.4286	174	0.5285	0.5505	0.5285	0.7270
No log	0.4335	176	0.6772	0.5107	0.6772	0.8229
No log	0.4384	178	1.1104	0.3932	1.1104	1.0538
No log	0.4433	180	0.9902	0.4457	0.9902	0.9951
No log	0.4483	182	0.6380	0.5112	0.6380	0.7987
No log	0.4532	184	0.5366	0.5754	0.5366	0.7325
No log	0.4581	186	0.5233	0.6089	0.5233	0.7234
No log	0.4631	188	0.5784	0.5525	0.5784	0.7606
No log	0.4680	190	0.7200	0.5037	0.7200	0.8485
No log	0.4729	192	0.6236	0.5484	0.6236	0.7897
No log	0.4778	194	0.5337	0.6114	0.5337	0.7305
No log	0.4828	196	0.5637	0.5281	0.5637	0.7508
No log	0.4877	198	0.5420	0.5621	0.5420	0.7362
No log	0.4926	200	0.6924	0.5013	0.6924	0.8321
No log	0.4975	202	0.9465	0.4363	0.9465	0.9729
No log	0.5025	204	0.8229	0.4472	0.8229	0.9071
No log	0.5074	206	0.5558	0.5468	0.5558	0.7455
No log	0.5123	208	0.5387	0.5537	0.5387	0.7339
No log	0.5172	210	0.5254	0.5669	0.5254	0.7248
No log	0.5222	212	0.6134	0.5174	0.6134	0.7832
No log	0.5271	214	0.6843	0.5178	0.6843	0.8272
No log	0.5320	216	0.5729	0.5693	0.5729	0.7569
No log	0.5369	218	0.5405	0.5703	0.5405	0.7352
No log	0.5419	220	0.5901	0.5277	0.5901	0.7682
No log	0.5468	222	0.7462	0.4707	0.7462	0.8638
No log	0.5517	224	0.9278	0.4026	0.9278	0.9632
No log	0.5567	226	0.8518	0.3979	0.8518	0.9229
No log	0.5616	228	0.6941	0.4446	0.6941	0.8331
No log	0.5665	230	0.7366	0.4447	0.7366	0.8583
No log	0.5714	232	0.9810	0.3867	0.9810	0.9905
No log	0.5764	234	0.9273	0.4120	0.9273	0.9630
No log	0.5813	236	0.6376	0.4818	0.6376	0.7985
No log	0.5862	238	0.5530	0.5264	0.5530	0.7436
No log	0.5911	240	0.5440	0.5598	0.5440	0.7375
No log	0.5961	242	0.5879	0.5305	0.5879	0.7667
No log	0.6010	244	0.6726	0.5209	0.6726	0.8201
No log	0.6059	246	0.5916	0.5826	0.5916	0.7692
No log	0.6108	248	0.5284	0.6160	0.5284	0.7269
No log	0.6158	250	0.5199	0.5919	0.5199	0.7210
No log	0.6207	252	0.5181	0.5803	0.5181	0.7198
No log	0.6256	254	0.5454	0.6075	0.5454	0.7385
No log	0.6305	256	0.5264	0.5964	0.5264	0.7255
No log	0.6355	258	0.5361	0.5467	0.5361	0.7322
No log	0.6404	260	0.5224	0.5523	0.5224	0.7227
No log	0.6453	262	0.5329	0.5847	0.5329	0.7300
No log	0.6502	264	0.5846	0.5514	0.5846	0.7646
No log	0.6552	266	0.5440	0.5705	0.5440	0.7376
No log	0.6601	268	0.5917	0.5490	0.5917	0.7692
No log	0.6650	270	0.5993	0.5432	0.5993	0.7741
No log	0.6700	272	0.5648	0.5431	0.5648	0.7515
No log	0.6749	274	0.5999	0.5495	0.5999	0.7746
No log	0.6798	276	0.7386	0.4909	0.7386	0.8594
No log	0.6847	278	1.0426	0.4491	1.0426	1.0211
No log	0.6897	280	0.9005	0.4801	0.9005	0.9490
No log	0.6946	282	0.5863	0.5764	0.5863	0.7657
No log	0.6995	284	0.5309	0.5578	0.5309	0.7286
No log	0.7044	286	0.5361	0.5799	0.5361	0.7322
No log	0.7094	288	0.7339	0.4871	0.7339	0.8567
No log	0.7143	290	0.8310	0.4768	0.8310	0.9116
No log	0.7192	292	0.6184	0.5447	0.6184	0.7864
No log	0.7241	294	0.5325	0.5704	0.5325	0.7298
No log	0.7291	296	0.7291	0.4214	0.7291	0.8539
No log	0.7340	298	0.7356	0.4302	0.7356	0.8577
No log	0.7389	300	0.5650	0.5630	0.5650	0.7516
No log	0.7438	302	0.5782	0.6177	0.5782	0.7604
No log	0.7488	304	0.6449	0.5815	0.6449	0.8031
No log	0.7537	306	0.5584	0.6166	0.5584	0.7473
No log	0.7586	308	0.5439	0.5793	0.5439	0.7375
No log	0.7635	310	0.5850	0.5707	0.5850	0.7649
No log	0.7685	312	0.5343	0.6016	0.5343	0.7309
No log	0.7734	314	0.5924	0.5813	0.5924	0.7697
No log	0.7783	316	0.7225	0.5503	0.7225	0.8500
No log	0.7833	318	0.6295	0.5848	0.6295	0.7934
No log	0.7882	320	0.5184	0.5971	0.5184	0.7200
No log	0.7931	322	0.5259	0.5849	0.5259	0.7252
No log	0.7980	324	0.5993	0.5657	0.5993	0.7741
No log	0.8030	326	0.6472	0.5462	0.6472	0.8045
No log	0.8079	328	0.7185	0.5132	0.7185	0.8477
No log	0.8128	330	0.6743	0.5380	0.6743	0.8212
No log	0.8177	332	0.5992	0.5750	0.5992	0.7741
No log	0.8227	334	0.6390	0.5633	0.6390	0.7994
No log	0.8276	336	0.5926	0.5944	0.5926	0.7698
No log	0.8325	338	0.5311	0.6209	0.5311	0.7288
No log	0.8374	340	0.5421	0.6280	0.5421	0.7363
No log	0.8424	342	0.5824	0.6306	0.5824	0.7632
No log	0.8473	344	0.6236	0.6111	0.6236	0.7897
No log	0.8522	346	0.6982	0.5574	0.6982	0.8356
No log	0.8571	348	0.5674	0.6167	0.5674	0.7532
No log	0.8621	350	0.5554	0.6172	0.5554	0.7452
No log	0.8670	352	0.6068	0.5907	0.6068	0.7790
No log	0.8719	354	0.5836	0.6061	0.5836	0.7639
No log	0.8768	356	0.5551	0.6292	0.5551	0.7451
No log	0.8818	358	0.5496	0.6408	0.5496	0.7413
No log	0.8867	360	0.5611	0.6367	0.5611	0.7491
No log	0.8916	362	0.5788	0.6108	0.5788	0.7608
No log	0.8966	364	0.5864	0.6294	0.5864	0.7658
No log	0.9015	366	0.6137	0.6245	0.6137	0.7834
No log	0.9064	368	0.6037	0.6264	0.6037	0.7770
No log	0.9113	370	0.6074	0.6249	0.6074	0.7793
No log	0.9163	372	0.6092	0.5956	0.6092	0.7805
No log	0.9212	374	0.5595	0.6471	0.5595	0.7480
No log	0.9261	376	0.5721	0.6445	0.5721	0.7564
No log	0.9310	378	0.5497	0.6146	0.5497	0.7414
No log	0.9360	380	0.6172	0.6017	0.6172	0.7856
No log	0.9409	382	0.8842	0.4809	0.8842	0.9403
No log	0.9458	384	0.8845	0.4736	0.8845	0.9405
No log	0.9507	386	0.6287	0.5626	0.6287	0.7929
No log	0.9557	388	0.5563	0.5889	0.5563	0.7459
No log	0.9606	390	0.5666	0.6146	0.5666	0.7527
No log	0.9655	392	0.6792	0.5609	0.6792	0.8241
No log	0.9704	394	0.6578	0.5619	0.6578	0.8110
No log	0.9754	396	0.5254	0.6050	0.5254	0.7249
No log	0.9803	398	0.5173	0.6103	0.5173	0.7192
No log	0.9852	400	0.5383	0.5996	0.5383	0.7337
No log	0.9901	402	0.5584	0.6138	0.5584	0.7473
No log	0.9951	404	0.5273	0.6194	0.5273	0.7262
No log	1.0	406	0.5224	0.6045	0.5224	0.7228
No log	1.0049	408	0.5333	0.5858	0.5333	0.7303
No log	1.0099	410	0.5295	0.6231	0.5295	0.7277
No log	1.0148	412	0.7751	0.5090	0.7751	0.8804
No log	1.0197	414	0.8304	0.4884	0.8304	0.9113
No log	1.0246	416	0.6393	0.5131	0.6393	0.7996
No log	1.0296	418	0.5274	0.5963	0.5274	0.7262
No log	1.0345	420	0.5245	0.5805	0.5245	0.7242
No log	1.0394	422	0.5844	0.5528	0.5844	0.7645
No log	1.0443	424	0.6738	0.5157	0.6738	0.8209
No log	1.0493	426	0.5926	0.5530	0.5926	0.7698
No log	1.0542	428	0.5525	0.5679	0.5525	0.7433
No log	1.0591	430	0.5286	0.6033	0.5286	0.7271
No log	1.0640	432	0.5507	0.5875	0.5507	0.7421
No log	1.0690	434	0.5707	0.5953	0.5707	0.7554
No log	1.0739	436	0.5642	0.6096	0.5642	0.7511
No log	1.0788	438	0.5686	0.6132	0.5686	0.7541
No log	1.0837	440	0.5804	0.6400	0.5804	0.7619
No log	1.0887	442	0.5833	0.6269	0.5833	0.7638
No log	1.0936	444	0.5306	0.6374	0.5306	0.7284
No log	1.0985	446	0.5338	0.6348	0.5338	0.7306
No log	1.1034	448	0.5428	0.6254	0.5428	0.7368
No log	1.1084	450	0.5453	0.6149	0.5453	0.7384
No log	1.1133	452	0.5698	0.5978	0.5698	0.7548
No log	1.1182	454	0.6823	0.5602	0.6823	0.8260
No log	1.1232	456	0.6192	0.5805	0.6192	0.7869
No log	1.1281	458	0.5344	0.5937	0.5344	0.7310
No log	1.1330	460	0.5751	0.5375	0.5751	0.7584
No log	1.1379	462	0.5318	0.6044	0.5318	0.7292
No log	1.1429	464	0.6556	0.5835	0.6556	0.8097
No log	1.1478	466	0.8071	0.5160	0.8071	0.8984
No log	1.1527	468	0.6838	0.5670	0.6838	0.8269
No log	1.1576	470	0.5480	0.6034	0.5480	0.7403
No log	1.1626	472	0.5545	0.5908	0.5545	0.7446
No log	1.1675	474	0.6123	0.5686	0.6123	0.7825
No log	1.1724	476	0.7098	0.5469	0.7098	0.8425
No log	1.1773	478	0.6827	0.5726	0.6827	0.8262
No log	1.1823	480	0.5501	0.6158	0.5501	0.7417
No log	1.1872	482	0.5440	0.6127	0.5440	0.7376
No log	1.1921	484	0.5919	0.6135	0.5919	0.7693
No log	1.1970	486	0.5429	0.6103	0.5429	0.7368
No log	1.2020	488	0.5360	0.6210	0.5360	0.7321
No log	1.2069	490	0.5071	0.6323	0.5071	0.7121
No log	1.2118	492	0.5161	0.6447	0.5161	0.7184
No log	1.2167	494	0.5275	0.6321	0.5275	0.7263
No log	1.2217	496	0.5750	0.6109	0.5750	0.7583
No log	1.2266	498	0.5897	0.6013	0.5897	0.7679
0.8711	1.2315	500	0.5274	0.6038	0.5274	0.7262
0.8711	1.2365	502	0.5365	0.5941	0.5365	0.7324
0.8711	1.2414	504	0.5567	0.5855	0.5567	0.7462
0.8711	1.2463	506	0.5612	0.5775	0.5612	0.7492
0.8711	1.2512	508	0.6545	0.5623	0.6545	0.8090
0.8711	1.2562	510	0.6215	0.5835	0.6215	0.7883

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1