ASAP_FineTuningBERT_AugV4_k15_task1_organization_fold2

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6259
• Qwk: 0.4995
• Mse: 0.6259
• Rmse: 0.7912

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0013	2	10.0087	0.0043	10.0087	3.1637
No log	0.0027	4	9.2839	0.0	9.2839	3.0469
No log	0.0040	6	8.9259	0.0	8.9259	2.9876
No log	0.0054	8	8.5065	0.0	8.5065	2.9166
No log	0.0067	10	7.9170	0.0	7.9170	2.8137
No log	0.0080	12	7.2186	0.0	7.2186	2.6867
No log	0.0094	14	6.3784	0.0	6.3784	2.5255
No log	0.0107	16	5.7082	0.0232	5.7082	2.3892
No log	0.0120	18	4.8822	0.0060	4.8822	2.2096
No log	0.0134	20	4.0900	0.0	4.0900	2.0224
No log	0.0147	22	3.4078	0.0	3.4078	1.8460
No log	0.0161	24	2.8196	0.0	2.8196	1.6792
No log	0.0174	26	2.1595	0.0929	2.1595	1.4695
No log	0.0187	28	1.6530	0.0268	1.6530	1.2857
No log	0.0201	30	1.3022	0.0	1.3022	1.1412
No log	0.0214	32	1.0443	0.0	1.0443	1.0219
No log	0.0228	34	0.8992	0.1188	0.8992	0.9483
No log	0.0241	36	0.8213	0.1102	0.8213	0.9062
No log	0.0254	38	0.8411	0.0371	0.8411	0.9171
No log	0.0268	40	0.9334	0.0	0.9334	0.9661
No log	0.0281	42	0.9550	0.0	0.9550	0.9772
No log	0.0295	44	1.0385	0.0	1.0385	1.0191
No log	0.0308	46	0.9779	0.0	0.9779	0.9889
No log	0.0321	48	1.0507	0.0	1.0507	1.0250
No log	0.0335	50	1.2812	0.0016	1.2812	1.1319
No log	0.0348	52	1.0777	0.0	1.0777	1.0381
No log	0.0361	54	1.0442	0.0	1.0442	1.0218
No log	0.0375	56	1.0783	0.0	1.0783	1.0384
No log	0.0388	58	1.0477	0.0	1.0477	1.0236
No log	0.0402	60	0.9223	0.0104	0.9223	0.9604
No log	0.0415	62	1.0718	0.0	1.0718	1.0353
No log	0.0428	64	1.2019	0.0	1.2019	1.0963
No log	0.0442	66	1.1342	0.0	1.1342	1.0650
No log	0.0455	68	1.0175	0.0	1.0175	1.0087
No log	0.0469	70	1.0086	0.0	1.0086	1.0043
No log	0.0482	72	1.0129	0.0	1.0129	1.0064
No log	0.0495	74	0.9658	0.0	0.9658	0.9828
No log	0.0509	76	1.0520	0.0	1.0520	1.0257
No log	0.0522	78	1.2023	0.0	1.2023	1.0965
No log	0.0535	80	1.2586	0.0089	1.2586	1.1219
No log	0.0549	82	1.0835	0.0	1.0835	1.0409
No log	0.0562	84	1.0512	0.0	1.0512	1.0253
No log	0.0576	86	1.1139	0.0	1.1139	1.0554
No log	0.0589	88	0.9788	0.0104	0.9788	0.9893
No log	0.0602	90	0.7583	0.0556	0.7583	0.8708
No log	0.0616	92	0.7576	0.2529	0.7576	0.8704
No log	0.0629	94	0.7519	0.0743	0.7519	0.8671
No log	0.0643	96	0.9119	0.0208	0.9119	0.9549
No log	0.0656	98	1.0420	0.0	1.0420	1.0208
No log	0.0669	100	1.0737	0.0	1.0737	1.0362
No log	0.0683	102	0.9611	0.0148	0.9611	0.9804
No log	0.0696	104	0.7950	0.0545	0.7950	0.8916
No log	0.0710	106	0.7443	0.1384	0.7443	0.8627
No log	0.0723	108	0.7336	0.2519	0.7336	0.8565
No log	0.0736	110	0.7175	0.1993	0.7175	0.8471
No log	0.0750	112	0.7418	0.1197	0.7418	0.8613
No log	0.0763	114	0.7416	0.1172	0.7416	0.8611
No log	0.0776	116	0.7870	0.0615	0.7870	0.8872
No log	0.0790	118	0.7860	0.0615	0.7860	0.8866
No log	0.0803	120	0.7068	0.1352	0.7068	0.8407
No log	0.0817	122	0.6827	0.2115	0.6827	0.8263
No log	0.0830	124	0.6904	0.1548	0.6904	0.8309
No log	0.0843	126	0.7080	0.1154	0.7080	0.8414
No log	0.0857	128	0.6476	0.2869	0.6476	0.8047
No log	0.0870	130	0.6396	0.3641	0.6396	0.7997
No log	0.0884	132	0.6623	0.2216	0.6623	0.8138
No log	0.0897	134	0.6591	0.3069	0.6591	0.8118
No log	0.0910	136	0.6293	0.3607	0.6293	0.7933
No log	0.0924	138	0.6222	0.3763	0.6222	0.7888
No log	0.0937	140	0.7488	0.3849	0.7488	0.8653
No log	0.0950	142	0.8166	0.3700	0.8166	0.9036
No log	0.0964	144	0.7009	0.4076	0.7009	0.8372
No log	0.0977	146	0.6125	0.4272	0.6125	0.7826
No log	0.0991	148	0.6787	0.3893	0.6787	0.8238
No log	0.1004	150	0.7017	0.4041	0.7017	0.8377
No log	0.1017	152	0.6779	0.3946	0.6779	0.8233
No log	0.1031	154	0.6595	0.3959	0.6595	0.8121
No log	0.1044	156	0.6904	0.3490	0.6904	0.8309
No log	0.1058	158	0.8434	0.3094	0.8434	0.9184
No log	0.1071	160	0.8554	0.3036	0.8554	0.9249
No log	0.1084	162	0.7317	0.3227	0.7317	0.8554
No log	0.1098	164	0.6773	0.3831	0.6773	0.8230
No log	0.1111	166	0.6988	0.3239	0.6988	0.8359
No log	0.1124	168	0.6721	0.3239	0.6721	0.8198
No log	0.1138	170	0.6380	0.4120	0.6380	0.7988
No log	0.1151	172	0.7470	0.3893	0.7470	0.8643
No log	0.1165	174	0.7047	0.4117	0.7047	0.8395
No log	0.1178	176	0.6701	0.4253	0.6701	0.8186
No log	0.1191	178	0.6539	0.4056	0.6539	0.8087
No log	0.1205	180	0.6257	0.4362	0.6257	0.7910
No log	0.1218	182	0.7543	0.3612	0.7543	0.8685
No log	0.1232	184	0.7963	0.3565	0.7963	0.8923
No log	0.1245	186	0.7425	0.3710	0.7425	0.8617
No log	0.1258	188	0.6314	0.4493	0.6314	0.7946
No log	0.1272	190	0.6649	0.4509	0.6649	0.8154
No log	0.1285	192	0.7126	0.4491	0.7126	0.8442
No log	0.1299	194	0.6366	0.4768	0.6366	0.7979
No log	0.1312	196	0.6245	0.4638	0.6245	0.7902
No log	0.1325	198	0.6476	0.4825	0.6476	0.8048
No log	0.1339	200	0.6436	0.4376	0.6436	0.8022
No log	0.1352	202	0.7552	0.3795	0.7552	0.8690
No log	0.1365	204	0.9866	0.3231	0.9866	0.9933
No log	0.1379	206	0.7884	0.3138	0.7884	0.8879
No log	0.1392	208	0.6743	0.3700	0.6743	0.8212
No log	0.1406	210	0.6318	0.4356	0.6318	0.7948
No log	0.1419	212	0.6306	0.4446	0.6306	0.7941
No log	0.1432	214	0.6084	0.4643	0.6084	0.7800
No log	0.1446	216	0.5982	0.4664	0.5982	0.7735
No log	0.1459	218	0.7431	0.4217	0.7431	0.8620
No log	0.1473	220	1.1058	0.2957	1.1058	1.0516
No log	0.1486	222	1.1012	0.2877	1.1012	1.0494
No log	0.1499	224	0.8422	0.3119	0.8422	0.9177
No log	0.1513	226	0.7371	0.3286	0.7371	0.8585
No log	0.1526	228	0.8411	0.2757	0.8411	0.9171
No log	0.1539	230	1.0612	0.2593	1.0612	1.0301
No log	0.1553	232	1.1725	0.2499	1.1725	1.0828
No log	0.1566	234	0.9943	0.2463	0.9943	0.9971
No log	0.1580	236	0.8045	0.2272	0.8045	0.8969
No log	0.1593	238	0.7916	0.2602	0.7916	0.8897
No log	0.1606	240	0.9602	0.2693	0.9602	0.9799
No log	0.1620	242	0.9996	0.2890	0.9996	0.9998
No log	0.1633	244	0.9424	0.3224	0.9424	0.9708
No log	0.1647	246	0.8661	0.3789	0.8661	0.9306
No log	0.1660	248	0.9977	0.3617	0.9977	0.9988
No log	0.1673	250	1.0424	0.3399	1.0424	1.0210
No log	0.1687	252	0.8678	0.3925	0.8678	0.9316
No log	0.1700	254	0.6579	0.4401	0.6579	0.8111
No log	0.1714	256	0.6242	0.4377	0.6242	0.7901
No log	0.1727	258	0.6218	0.4331	0.6218	0.7885
No log	0.1740	260	0.6535	0.4095	0.6535	0.8084
No log	0.1754	262	0.6802	0.4397	0.6802	0.8248
No log	0.1767	264	0.6263	0.3984	0.6263	0.7914
No log	0.1780	266	0.6365	0.4133	0.6365	0.7978
No log	0.1794	268	0.6224	0.4308	0.6224	0.7889
No log	0.1807	270	0.6368	0.3946	0.6368	0.7980
No log	0.1821	272	0.6346	0.3901	0.6346	0.7966
No log	0.1834	274	0.6802	0.4042	0.6802	0.8248
No log	0.1847	276	0.7286	0.4002	0.7286	0.8536
No log	0.1861	278	0.6631	0.3959	0.6631	0.8143
No log	0.1874	280	0.6708	0.3916	0.6708	0.8190
No log	0.1888	282	0.7624	0.3806	0.7624	0.8731
No log	0.1901	284	0.7405	0.3783	0.7405	0.8605
No log	0.1914	286	0.6225	0.3904	0.6225	0.7890
No log	0.1928	288	0.6041	0.4292	0.6041	0.7773
No log	0.1941	290	0.6444	0.4057	0.6444	0.8028
No log	0.1954	292	0.8369	0.4004	0.8369	0.9148
No log	0.1968	294	1.0975	0.3268	1.0975	1.0476
No log	0.1981	296	0.9873	0.3642	0.9873	0.9936
No log	0.1995	298	0.6855	0.4067	0.6855	0.8279
No log	0.2008	300	0.6112	0.4286	0.6112	0.7818
No log	0.2021	302	0.6545	0.4006	0.6545	0.8090
No log	0.2035	304	0.8069	0.3977	0.8069	0.8983
No log	0.2048	306	0.8867	0.3866	0.8867	0.9416
No log	0.2062	308	0.8316	0.3989	0.8316	0.9119
No log	0.2075	310	0.6828	0.4168	0.6828	0.8263
No log	0.2088	312	0.6007	0.4394	0.6007	0.7751
No log	0.2102	314	0.6393	0.4602	0.6393	0.7996
No log	0.2115	316	0.8630	0.4000	0.8630	0.9290
No log	0.2129	318	1.0200	0.3442	1.0200	1.0099
No log	0.2142	320	0.9438	0.3726	0.9438	0.9715
No log	0.2155	322	0.7303	0.4276	0.7303	0.8546
No log	0.2169	324	0.7195	0.4254	0.7195	0.8483
No log	0.2182	326	0.8646	0.3920	0.8646	0.9298
No log	0.2195	328	0.9365	0.3745	0.9365	0.9677
No log	0.2209	330	0.7811	0.3804	0.7811	0.8838
No log	0.2222	332	0.6559	0.4304	0.6559	0.8099
No log	0.2236	334	0.6963	0.4580	0.6963	0.8344
No log	0.2249	336	0.8133	0.4078	0.8133	0.9018
No log	0.2262	338	0.8075	0.4176	0.8075	0.8986
No log	0.2276	340	0.6714	0.4548	0.6714	0.8194
No log	0.2289	342	0.6437	0.4477	0.6437	0.8023
No log	0.2303	344	0.6980	0.4598	0.6980	0.8355
No log	0.2316	346	0.6743	0.4593	0.6743	0.8212
No log	0.2329	348	0.6955	0.4593	0.6955	0.8340
No log	0.2343	350	0.7785	0.4568	0.7785	0.8823
No log	0.2356	352	0.6592	0.4849	0.6592	0.8119
No log	0.2369	354	0.5739	0.5310	0.5739	0.7576
No log	0.2383	356	0.5784	0.5361	0.5784	0.7605
No log	0.2396	358	0.6671	0.4935	0.6671	0.8168
No log	0.2410	360	0.7124	0.4804	0.7124	0.8440
No log	0.2423	362	0.6755	0.4976	0.6755	0.8219
No log	0.2436	364	0.6808	0.5022	0.6808	0.8251
No log	0.2450	366	0.6303	0.5043	0.6303	0.7939
No log	0.2463	368	0.6108	0.5063	0.6108	0.7815
No log	0.2477	370	0.5927	0.5058	0.5927	0.7699
No log	0.2490	372	0.5900	0.5033	0.5900	0.7681
No log	0.2503	374	0.6572	0.4711	0.6572	0.8107
No log	0.2517	376	0.6174	0.5001	0.6174	0.7857
No log	0.2530	378	0.5880	0.5057	0.5880	0.7668
No log	0.2544	380	0.5717	0.5178	0.5717	0.7561
No log	0.2557	382	0.6180	0.5084	0.6180	0.7861
No log	0.2570	384	0.7620	0.4488	0.7620	0.8729
No log	0.2584	386	0.7722	0.4539	0.7722	0.8787
No log	0.2597	388	0.5987	0.5086	0.5987	0.7738
No log	0.2610	390	0.5695	0.5225	0.5695	0.7547
No log	0.2624	392	0.6707	0.4764	0.6707	0.8190
No log	0.2637	394	0.8313	0.4321	0.8313	0.9117
No log	0.2651	396	0.7469	0.4511	0.7469	0.8642
No log	0.2664	398	0.6155	0.4770	0.6155	0.7846
No log	0.2677	400	0.6400	0.4653	0.6400	0.8000
No log	0.2691	402	0.6735	0.4627	0.6735	0.8207
No log	0.2704	404	0.6191	0.4710	0.6191	0.7868
No log	0.2718	406	0.6419	0.4649	0.6419	0.8012
No log	0.2731	408	0.7645	0.4737	0.7645	0.8744
No log	0.2744	410	0.8713	0.4258	0.8713	0.9334
No log	0.2758	412	0.8217	0.4517	0.8217	0.9065
No log	0.2771	414	1.0672	0.3850	1.0672	1.0331
No log	0.2784	416	1.1163	0.3611	1.1163	1.0566
No log	0.2798	418	0.9011	0.4151	0.9011	0.9492
No log	0.2811	420	0.6975	0.4333	0.6975	0.8352
No log	0.2825	422	0.7568	0.4359	0.7568	0.8699
No log	0.2838	424	0.9671	0.4057	0.9671	0.9834
No log	0.2851	426	1.1806	0.3267	1.1806	1.0866
No log	0.2865	428	1.0262	0.3871	1.0262	1.0130
No log	0.2878	430	0.7013	0.4646	0.7013	0.8374
No log	0.2892	432	0.5749	0.4542	0.5749	0.7583
No log	0.2905	434	0.5794	0.4848	0.5794	0.7612
No log	0.2918	436	0.7233	0.4721	0.7233	0.8505
No log	0.2932	438	0.8101	0.4591	0.8101	0.9000
No log	0.2945	440	0.7747	0.4629	0.7747	0.8801
No log	0.2959	442	0.8359	0.4593	0.8359	0.9143
No log	0.2972	444	0.6657	0.4864	0.6657	0.8159
No log	0.2985	446	0.6295	0.5066	0.6295	0.7934
No log	0.2999	448	0.6515	0.4864	0.6515	0.8072
No log	0.3012	450	0.6191	0.5088	0.6191	0.7868
No log	0.3025	452	0.6180	0.5267	0.6180	0.7861
No log	0.3039	454	0.6493	0.5092	0.6493	0.8058
No log	0.3052	456	0.7179	0.4711	0.7179	0.8473
No log	0.3066	458	0.8127	0.4430	0.8127	0.9015
No log	0.3079	460	0.6961	0.4677	0.6961	0.8344
No log	0.3092	462	0.5942	0.4927	0.5942	0.7708
No log	0.3106	464	0.5965	0.4891	0.5965	0.7723
No log	0.3119	466	0.6420	0.4489	0.6420	0.8012
No log	0.3133	468	0.7930	0.4146	0.7930	0.8905
No log	0.3146	470	0.7504	0.4249	0.7504	0.8662
No log	0.3159	472	0.7849	0.4178	0.7849	0.8859
No log	0.3173	474	0.7660	0.4440	0.7660	0.8752
No log	0.3186	476	0.7182	0.4532	0.7182	0.8474
No log	0.3199	478	0.7072	0.4580	0.7072	0.8409
No log	0.3213	480	0.7495	0.4627	0.7495	0.8657
No log	0.3226	482	0.8981	0.4165	0.8981	0.9477
No log	0.3240	484	0.8354	0.4373	0.8354	0.9140
No log	0.3253	486	0.6192	0.4916	0.6192	0.7869
No log	0.3266	488	0.5806	0.4859	0.5806	0.7620
No log	0.3280	490	0.5934	0.4923	0.5934	0.7703
No log	0.3293	492	0.7222	0.4603	0.7222	0.8498
No log	0.3307	494	0.7850	0.4542	0.7850	0.8860
No log	0.3320	496	0.7262	0.4866	0.7262	0.8522
No log	0.3333	498	0.6133	0.5297	0.6133	0.7831
1.091	0.3347	500	0.5861	0.5399	0.5861	0.7656
1.091	0.3360	502	0.5787	0.5457	0.5787	0.7607
1.091	0.3373	504	0.6208	0.5279	0.6208	0.7879
1.091	0.3387	506	0.6453	0.5047	0.6453	0.8033
1.091	0.3400	508	0.6075	0.5162	0.6075	0.7794
1.091	0.3414	510	0.5900	0.5118	0.5900	0.7681
1.091	0.3427	512	0.6259	0.4995	0.6259	0.7912

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1