ASAP_FineTuningBERT_AugV4_k2_task1_organization_fold1

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.4515
• Qwk: 0.6980
• Mse: 0.4515
• Rmse: 0.6720

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0087	2	12.2641	0.0	12.2641	3.5020
No log	0.0173	4	10.9376	-0.0048	10.9376	3.3072
No log	0.0260	6	10.1217	0.0	10.1217	3.1815
No log	0.0346	8	8.9679	0.0	8.9679	2.9946
No log	0.0433	10	7.6534	0.0	7.6534	2.7665
No log	0.0519	12	6.4598	0.0	6.4598	2.5416
No log	0.0606	14	5.1387	0.0402	5.1387	2.2669
No log	0.0693	16	4.1498	0.0	4.1498	2.0371
No log	0.0779	18	3.3994	0.0	3.3994	1.8437
No log	0.0866	20	2.5545	0.0	2.5545	1.5983
No log	0.0952	22	1.9409	0.1265	1.9409	1.3932
No log	0.1039	24	1.5198	0.0132	1.5198	1.2328
No log	0.1126	26	1.1844	0.0	1.1844	1.0883
No log	0.1212	28	1.0037	0.0	1.0037	1.0019
No log	0.1299	30	0.9068	0.2634	0.9068	0.9522
No log	0.1385	32	0.8841	0.0518	0.8841	0.9403
No log	0.1472	34	0.8787	0.0375	0.8787	0.9374
No log	0.1558	36	0.9420	0.0233	0.9420	0.9706
No log	0.1645	38	0.9358	0.0233	0.9358	0.9674
No log	0.1732	40	1.0365	0.0	1.0365	1.0181
No log	0.1818	42	0.9529	0.0233	0.9529	0.9762
No log	0.1905	44	1.0143	0.0	1.0143	1.0071
No log	0.1991	46	1.1723	0.2282	1.1723	1.0827
No log	0.2078	48	0.8762	0.0727	0.8762	0.9360
No log	0.2165	50	0.7116	0.3926	0.7116	0.8436
No log	0.2251	52	0.7290	0.4153	0.7290	0.8538
No log	0.2338	54	0.6938	0.2877	0.6938	0.8330
No log	0.2424	56	0.8099	0.1102	0.8099	0.8999
No log	0.2511	58	0.7937	0.1190	0.7937	0.8909
No log	0.2597	60	0.7839	0.1190	0.7839	0.8854
No log	0.2684	62	0.7218	0.2530	0.7218	0.8496
No log	0.2771	64	0.7199	0.3848	0.7199	0.8485
No log	0.2857	66	0.6927	0.4106	0.6927	0.8323
No log	0.2944	68	0.6395	0.3517	0.6395	0.7997
No log	0.3030	70	0.7749	0.3226	0.7749	0.8803
No log	0.3117	72	0.7336	0.3723	0.7336	0.8565
No log	0.3203	74	0.5608	0.4364	0.5608	0.7489
No log	0.3290	76	0.6621	0.4424	0.6621	0.8137
No log	0.3377	78	0.7283	0.3986	0.7283	0.8534
No log	0.3463	80	0.5829	0.4625	0.5829	0.7635
No log	0.3550	82	0.5972	0.3430	0.5972	0.7728
No log	0.3636	84	1.0326	0.2406	1.0326	1.0162
No log	0.3723	86	1.1095	0.1791	1.1095	1.0533
No log	0.3810	88	0.9143	0.0890	0.9143	0.9562
No log	0.3896	90	0.8684	0.0979	0.8684	0.9319
No log	0.3983	92	0.8392	0.1505	0.8392	0.9161
No log	0.4069	94	0.7050	0.1970	0.7050	0.8396
No log	0.4156	96	0.6471	0.2858	0.6472	0.8045
No log	0.4242	98	0.6339	0.4030	0.6339	0.7962
No log	0.4329	100	0.6251	0.3063	0.6251	0.7906
No log	0.4416	102	0.6884	0.2241	0.6884	0.8297
No log	0.4502	104	0.6735	0.3356	0.6735	0.8207
No log	0.4589	106	0.6040	0.3839	0.6040	0.7772
No log	0.4675	108	0.5747	0.4421	0.5747	0.7581
No log	0.4762	110	0.6201	0.4087	0.6201	0.7874
No log	0.4848	112	0.6057	0.4129	0.6057	0.7783
No log	0.4935	114	0.5814	0.4466	0.5814	0.7625
No log	0.5022	116	0.5691	0.4762	0.5691	0.7544
No log	0.5108	118	0.6075	0.5143	0.6075	0.7794
No log	0.5195	120	0.6446	0.4958	0.6446	0.8029
No log	0.5281	122	0.7202	0.4596	0.7202	0.8487
No log	0.5368	124	0.8326	0.4277	0.8326	0.9125
No log	0.5455	126	1.0229	0.3461	1.0229	1.0114
No log	0.5541	128	0.9640	0.3928	0.9640	0.9818
No log	0.5628	130	0.7569	0.4264	0.7569	0.8700
No log	0.5714	132	0.6794	0.4316	0.6794	0.8243
No log	0.5801	134	0.6649	0.4527	0.6649	0.8154
No log	0.5887	136	0.7305	0.4238	0.7305	0.8547
No log	0.5974	138	0.6854	0.4096	0.6854	0.8279
No log	0.6061	140	0.6623	0.3931	0.6623	0.8138
No log	0.6147	142	0.6380	0.4013	0.6380	0.7987
No log	0.6234	144	0.6174	0.5062	0.6174	0.7858
No log	0.6320	146	0.6934	0.4774	0.6934	0.8327
No log	0.6407	148	0.8099	0.4455	0.8099	0.8999
No log	0.6494	150	0.7787	0.4554	0.7787	0.8824
No log	0.6580	152	0.5648	0.5694	0.5648	0.7515
No log	0.6667	154	0.5109	0.5516	0.5109	0.7148
No log	0.6753	156	0.5705	0.5285	0.5705	0.7553
No log	0.6840	158	0.4607	0.5777	0.4607	0.6788
No log	0.6926	160	0.6263	0.5046	0.6263	0.7914
No log	0.7013	162	0.6249	0.4883	0.6249	0.7905
No log	0.7100	164	0.5216	0.5442	0.5216	0.7222
No log	0.7186	166	0.6104	0.4341	0.6104	0.7813
No log	0.7273	168	0.7075	0.3733	0.7075	0.8411
No log	0.7359	170	0.6107	0.4097	0.6107	0.7815
No log	0.7446	172	0.5249	0.5696	0.5249	0.7245
No log	0.7532	174	0.5411	0.5811	0.5411	0.7356
No log	0.7619	176	0.5288	0.5849	0.5288	0.7272
No log	0.7706	178	0.5206	0.5638	0.5206	0.7215
No log	0.7792	180	0.5168	0.5954	0.5168	0.7189
No log	0.7879	182	0.5243	0.5762	0.5243	0.7241
No log	0.7965	184	0.5106	0.5540	0.5106	0.7146
No log	0.8052	186	0.5216	0.4953	0.5216	0.7223
No log	0.8139	188	0.5010	0.5237	0.5010	0.7078
No log	0.8225	190	0.5336	0.5510	0.5336	0.7305
No log	0.8312	192	0.5691	0.5434	0.5691	0.7544
No log	0.8398	194	0.4930	0.5841	0.4930	0.7022
No log	0.8485	196	0.5484	0.5344	0.5484	0.7405
No log	0.8571	198	0.6834	0.4684	0.6834	0.8267
No log	0.8658	200	0.5844	0.4989	0.5844	0.7645
No log	0.8745	202	0.4707	0.6377	0.4707	0.6861
No log	0.8831	204	0.5036	0.5954	0.5036	0.7097
No log	0.8918	206	0.5104	0.5940	0.5104	0.7145
No log	0.9004	208	0.4727	0.6413	0.4727	0.6875
No log	0.9091	210	0.4764	0.6383	0.4764	0.6902
No log	0.9177	212	0.4615	0.6261	0.4615	0.6793
No log	0.9264	214	0.5173	0.5974	0.5173	0.7192
No log	0.9351	216	0.5241	0.5786	0.5241	0.7240
No log	0.9437	218	0.4569	0.5952	0.4569	0.6759
No log	0.9524	220	0.4512	0.6082	0.4512	0.6717
No log	0.9610	222	0.4644	0.6087	0.4644	0.6815
No log	0.9697	224	0.4882	0.6026	0.4882	0.6987
No log	0.9784	226	0.4911	0.5973	0.4911	0.7008
No log	0.9870	228	0.4847	0.6338	0.4847	0.6962
No log	0.9957	230	0.4921	0.6315	0.4921	0.7015
No log	1.0043	232	0.5311	0.5873	0.5311	0.7288
No log	1.0130	234	0.6764	0.5689	0.6764	0.8224
No log	1.0216	236	0.7971	0.5171	0.7971	0.8928
No log	1.0303	238	0.6120	0.5726	0.6120	0.7823
No log	1.0390	240	0.4724	0.6309	0.4724	0.6873
No log	1.0476	242	0.4570	0.6250	0.4570	0.6760
No log	1.0563	244	0.4604	0.6246	0.4604	0.6785
No log	1.0649	246	0.5060	0.6192	0.5060	0.7114
No log	1.0736	248	0.6576	0.5818	0.6576	0.8109
No log	1.0823	250	0.6005	0.6004	0.6005	0.7749
No log	1.0909	252	0.4606	0.6354	0.4606	0.6787
No log	1.0996	254	0.4902	0.6463	0.4902	0.7001
No log	1.1082	256	0.4670	0.6419	0.4670	0.6834
No log	1.1169	258	0.4997	0.6359	0.4997	0.7069
No log	1.1255	260	0.7103	0.5740	0.7103	0.8428
No log	1.1342	262	0.7439	0.5580	0.7439	0.8625
No log	1.1429	264	0.5424	0.6446	0.5424	0.7365
No log	1.1515	266	0.4601	0.6697	0.4601	0.6783
No log	1.1602	268	0.4905	0.6693	0.4905	0.7004
No log	1.1688	270	0.4859	0.6666	0.4859	0.6971
No log	1.1775	272	0.4510	0.6666	0.4510	0.6716
No log	1.1861	274	0.4948	0.6697	0.4948	0.7034
No log	1.1948	276	0.4728	0.6707	0.4728	0.6876
No log	1.2035	278	0.4579	0.6684	0.4579	0.6767
No log	1.2121	280	0.4686	0.6644	0.4686	0.6846
No log	1.2208	282	0.4633	0.6573	0.4633	0.6807
No log	1.2294	284	0.4422	0.6728	0.4422	0.6650
No log	1.2381	286	0.4539	0.6726	0.4539	0.6738
No log	1.2468	288	0.4854	0.6738	0.4854	0.6967
No log	1.2554	290	0.4687	0.6855	0.4687	0.6846
No log	1.2641	292	0.4608	0.6789	0.4608	0.6788
No log	1.2727	294	0.4625	0.6780	0.4625	0.6801
No log	1.2814	296	0.4861	0.6740	0.4861	0.6972
No log	1.2900	298	0.4809	0.6785	0.4809	0.6934
No log	1.2987	300	0.4919	0.6609	0.4919	0.7014
No log	1.3074	302	0.4697	0.6695	0.4697	0.6854
No log	1.3160	304	0.4762	0.6571	0.4762	0.6901
No log	1.3247	306	0.5493	0.6181	0.5493	0.7412
No log	1.3333	308	0.5431	0.6213	0.5431	0.7369
No log	1.3420	310	0.4592	0.6624	0.4592	0.6776
No log	1.3506	312	0.4855	0.6569	0.4855	0.6968
No log	1.3593	314	0.4669	0.6649	0.4669	0.6833
No log	1.3680	316	0.4741	0.6767	0.4741	0.6885
No log	1.3766	318	0.5439	0.6673	0.5439	0.7375
No log	1.3853	320	0.4795	0.6739	0.4795	0.6925
No log	1.3939	322	0.4363	0.6753	0.4363	0.6605
No log	1.4026	324	0.5584	0.6139	0.5584	0.7473
No log	1.4113	326	0.5264	0.6313	0.5264	0.7255
No log	1.4199	328	0.4278	0.6714	0.4278	0.6541
No log	1.4286	330	0.5630	0.6639	0.5630	0.7503
No log	1.4372	332	0.6434	0.6231	0.6434	0.8021
No log	1.4459	334	0.5300	0.6623	0.5300	0.7280
No log	1.4545	336	0.4405	0.6646	0.4405	0.6637
No log	1.4632	338	0.4523	0.6704	0.4523	0.6725
No log	1.4719	340	0.4685	0.6561	0.4685	0.6845
No log	1.4805	342	0.5150	0.6585	0.5150	0.7176
No log	1.4892	344	0.6686	0.6145	0.6686	0.8177
No log	1.4978	346	0.8184	0.5464	0.8184	0.9047
No log	1.5065	348	0.6989	0.5907	0.6989	0.8360
No log	1.5152	350	0.5005	0.6495	0.5005	0.7075
No log	1.5238	352	0.4354	0.6592	0.4354	0.6598
No log	1.5325	354	0.4338	0.6770	0.4338	0.6587
No log	1.5411	356	0.4287	0.6826	0.4287	0.6547
No log	1.5498	358	0.4714	0.6506	0.4714	0.6866
No log	1.5584	360	0.5228	0.6493	0.5228	0.7231
No log	1.5671	362	0.4930	0.6602	0.4930	0.7022
No log	1.5758	364	0.4970	0.6661	0.4970	0.7050
No log	1.5844	366	0.5099	0.6612	0.5099	0.7141
No log	1.5931	368	0.4898	0.6636	0.4898	0.6999
No log	1.6017	370	0.4835	0.6723	0.4835	0.6953
No log	1.6104	372	0.4731	0.6516	0.4731	0.6878
No log	1.6190	374	0.4738	0.6633	0.4738	0.6884
No log	1.6277	376	0.4614	0.6702	0.4614	0.6793
No log	1.6364	378	0.4492	0.6651	0.4492	0.6703
No log	1.6450	380	0.4650	0.6796	0.4650	0.6819
No log	1.6537	382	0.5271	0.6326	0.5271	0.7260
No log	1.6623	384	0.4834	0.6467	0.4834	0.6953
No log	1.6710	386	0.4910	0.6655	0.4910	0.7007
No log	1.6797	388	0.5300	0.6605	0.5300	0.7280
No log	1.6883	390	0.5334	0.6564	0.5334	0.7303
No log	1.6970	392	0.4920	0.6635	0.4920	0.7014
No log	1.7056	394	0.4554	0.6797	0.4554	0.6748
No log	1.7143	396	0.4315	0.6862	0.4315	0.6569
No log	1.7229	398	0.4432	0.6674	0.4432	0.6657
No log	1.7316	400	0.4850	0.6450	0.4850	0.6965
No log	1.7403	402	0.4733	0.6452	0.4733	0.6880
No log	1.7489	404	0.4440	0.6366	0.4440	0.6663
No log	1.7576	406	0.4398	0.6732	0.4398	0.6632
No log	1.7662	408	0.5143	0.6547	0.5143	0.7171
No log	1.7749	410	0.6122	0.6372	0.6122	0.7824
No log	1.7835	412	0.5437	0.6687	0.5437	0.7373
No log	1.7922	414	0.4248	0.6618	0.4248	0.6518
No log	1.8009	416	0.4822	0.6611	0.4822	0.6944
No log	1.8095	418	0.4765	0.6432	0.4765	0.6903
No log	1.8182	420	0.4257	0.6626	0.4257	0.6524
No log	1.8268	422	0.5291	0.6376	0.5291	0.7274
No log	1.8355	424	0.5891	0.6135	0.5891	0.7675
No log	1.8442	426	0.5197	0.6087	0.5197	0.7209
No log	1.8528	428	0.4736	0.6061	0.4736	0.6882
No log	1.8615	430	0.4563	0.6391	0.4563	0.6755
No log	1.8701	432	0.4761	0.6326	0.4761	0.6900
No log	1.8788	434	0.5478	0.6410	0.5478	0.7402
No log	1.8874	436	0.5340	0.6433	0.5340	0.7308
No log	1.8961	438	0.4812	0.6405	0.4812	0.6937
No log	1.9048	440	0.4801	0.6370	0.4801	0.6929
No log	1.9134	442	0.4813	0.6146	0.4813	0.6938
No log	1.9221	444	0.5286	0.5889	0.5286	0.7271
No log	1.9307	446	0.5347	0.5991	0.5347	0.7313
No log	1.9394	448	0.4958	0.6245	0.4958	0.7041
No log	1.9481	450	0.5147	0.6244	0.5147	0.7174
No log	1.9567	452	0.4957	0.6397	0.4957	0.7040
No log	1.9654	454	0.4584	0.6533	0.4584	0.6771
No log	1.9740	456	0.4345	0.6710	0.4345	0.6592
No log	1.9827	458	0.4687	0.6599	0.4687	0.6846
No log	1.9913	460	0.4570	0.6739	0.4570	0.6760
No log	2.0	462	0.4476	0.6739	0.4476	0.6690
No log	2.0087	464	0.4709	0.6654	0.4709	0.6862
No log	2.0173	466	0.4696	0.6595	0.4696	0.6853
No log	2.0260	468	0.4596	0.6801	0.4596	0.6779
No log	2.0346	470	0.4603	0.6644	0.4603	0.6784
No log	2.0433	472	0.4573	0.6703	0.4573	0.6762
No log	2.0519	474	0.4911	0.6777	0.4911	0.7008
No log	2.0606	476	0.4688	0.6661	0.4688	0.6847
No log	2.0693	478	0.5027	0.6630	0.5027	0.7090
No log	2.0779	480	0.5524	0.6407	0.5524	0.7433
No log	2.0866	482	0.5284	0.6422	0.5284	0.7269
No log	2.0952	484	0.5164	0.6452	0.5164	0.7186
No log	2.1039	486	0.6125	0.6140	0.6125	0.7826
No log	2.1126	488	0.5771	0.6336	0.5771	0.7597
No log	2.1212	490	0.4745	0.6489	0.4745	0.6888
No log	2.1299	492	0.4584	0.6398	0.4584	0.6770
No log	2.1385	494	0.4642	0.6606	0.4642	0.6813
No log	2.1472	496	0.4432	0.6884	0.4432	0.6657
No log	2.1558	498	0.4555	0.6825	0.4555	0.6749
1.062	2.1645	500	0.4544	0.7062	0.4544	0.6741
1.062	2.1732	502	0.4842	0.7042	0.4842	0.6959
1.062	2.1818	504	0.4766	0.6993	0.4766	0.6904
1.062	2.1905	506	0.4639	0.6923	0.4639	0.6811
1.062	2.1991	508	0.4663	0.6938	0.4663	0.6828
1.062	2.2078	510	0.4553	0.7109	0.4553	0.6748
1.062	2.2165	512	0.4608	0.6981	0.4608	0.6788
1.062	2.2251	514	0.4950	0.6951	0.4950	0.7036
1.062	2.2338	516	0.5072	0.7042	0.5072	0.7122
1.062	2.2424	518	0.4602	0.6882	0.4602	0.6784
1.062	2.2511	520	0.4515	0.6980	0.4515	0.6720

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1