ASAP_FineTuningBERT_AugV4_k15_task1_organization_fold1

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7856
• Qwk: 0.4847
• Mse: 0.7856
• Rmse: 0.8863

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0013	2	10.3202	-0.0001	10.3202	3.2125
No log	0.0026	4	8.5704	0.0	8.5704	2.9275
No log	0.0040	6	7.7413	0.0	7.7413	2.7823
No log	0.0053	8	6.6440	0.0	6.6440	2.5776
No log	0.0066	10	5.5958	0.0820	5.5958	2.3656
No log	0.0079	12	4.8646	0.0040	4.8646	2.2056
No log	0.0092	14	4.1095	0.0	4.1095	2.0272
No log	0.0106	16	3.3459	0.0	3.3459	1.8292
No log	0.0119	18	2.6499	0.0	2.6499	1.6279
No log	0.0132	20	2.0208	0.1152	2.0208	1.4216
No log	0.0145	22	1.4905	0.0	1.4905	1.2209
No log	0.0158	24	1.1891	0.0	1.1891	1.0905
No log	0.0172	26	0.9742	0.0	0.9742	0.9870
No log	0.0185	28	0.8740	0.3403	0.8740	0.9349
No log	0.0198	30	0.8581	0.1067	0.8581	0.9263
No log	0.0211	32	0.9432	0.0286	0.9432	0.9712
No log	0.0224	34	1.1398	0.0	1.1398	1.0676
No log	0.0238	36	1.1621	0.0	1.1621	1.0780
No log	0.0251	38	1.1270	0.0090	1.1270	1.0616
No log	0.0264	40	1.3954	0.0	1.3954	1.1813
No log	0.0277	42	1.3748	0.0	1.3748	1.1725
No log	0.0290	44	1.1881	0.0	1.1881	1.0900
No log	0.0304	46	1.0212	0.0	1.0212	1.0106
No log	0.0317	48	0.9915	0.0	0.9915	0.9957
No log	0.0330	50	0.9551	0.0143	0.9551	0.9773
No log	0.0343	52	0.9434	0.0286	0.9434	0.9713
No log	0.0356	54	0.9552	0.0286	0.9552	0.9773
No log	0.0370	56	1.0188	0.0	1.0188	1.0094
No log	0.0383	58	1.0197	0.0	1.0197	1.0098
No log	0.0396	60	1.0202	0.0	1.0202	1.0100
No log	0.0409	62	0.9458	0.0143	0.9458	0.9725
No log	0.0422	64	0.8928	0.0286	0.8928	0.9449
No log	0.0436	66	0.9064	0.0286	0.9064	0.9520
No log	0.0449	68	1.0075	0.0143	1.0075	1.0038
No log	0.0462	70	1.1836	0.0	1.1836	1.0879
No log	0.0475	72	1.1595	0.0	1.1595	1.0768
No log	0.0488	74	1.0238	0.0	1.0238	1.0118
No log	0.0502	76	1.0869	0.0143	1.0869	1.0426
No log	0.0515	78	1.1147	0.0286	1.1147	1.0558
No log	0.0528	80	1.2150	0.0070	1.2150	1.1023
No log	0.0541	82	1.3250	0.0220	1.3250	1.1511
No log	0.0554	84	1.2755	0.0362	1.2755	1.1294
No log	0.0568	86	1.1489	0.0034	1.1489	1.0719
No log	0.0581	88	1.0187	0.0	1.0187	1.0093
No log	0.0594	90	1.1382	0.0328	1.1382	1.0669
No log	0.0607	92	1.2615	0.2124	1.2615	1.1232
No log	0.0620	94	1.1825	0.1774	1.1825	1.0874
No log	0.0634	96	0.9694	0.0286	0.9694	0.9846
No log	0.0647	98	0.8097	0.0925	0.8097	0.8999
No log	0.0660	100	0.8010	0.0996	0.8010	0.8950
No log	0.0673	102	0.8009	0.0873	0.8009	0.8949
No log	0.0686	104	0.8105	0.0908	0.8105	0.9003
No log	0.0700	106	0.8312	0.0873	0.8312	0.9117
No log	0.0713	108	0.9008	0.0429	0.9008	0.9491
No log	0.0726	110	1.0593	0.0365	1.0593	1.0292
No log	0.0739	112	1.1079	0.0692	1.1079	1.0526
No log	0.0752	114	1.0405	0.0401	1.0405	1.0200
No log	0.0766	116	0.8869	0.0358	0.8869	0.9418
No log	0.0779	118	0.8261	0.1185	0.8261	0.9089
No log	0.0792	120	0.7901	0.1362	0.7901	0.8889
No log	0.0805	122	0.7537	0.1702	0.7537	0.8682
No log	0.0818	124	0.7728	0.1699	0.7728	0.8791
No log	0.0832	126	0.7958	0.3396	0.7958	0.8921
No log	0.0845	128	0.7899	0.4086	0.7899	0.8888
No log	0.0858	130	0.7784	0.4148	0.7784	0.8823
No log	0.0871	132	0.6976	0.3841	0.6976	0.8352
No log	0.0884	134	0.6722	0.3895	0.6722	0.8199
No log	0.0898	136	0.7143	0.4421	0.7143	0.8452
No log	0.0911	138	0.7766	0.3948	0.7766	0.8813
No log	0.0924	140	0.6581	0.3454	0.6581	0.8113
No log	0.0937	142	0.6111	0.3978	0.6111	0.7817
No log	0.0950	144	0.6449	0.3825	0.6449	0.8030
No log	0.0964	146	0.6766	0.4239	0.6766	0.8226
No log	0.0977	148	0.9192	0.3933	0.9192	0.9587
No log	0.0990	150	1.1446	0.3347	1.1446	1.0698
No log	0.1003	152	1.1454	0.3395	1.1454	1.0702
No log	0.1017	154	1.0274	0.3720	1.0274	1.0136
No log	0.1030	156	1.0871	0.3540	1.0871	1.0427
No log	0.1043	158	1.0708	0.3552	1.0708	1.0348
No log	0.1056	160	1.0910	0.3409	1.0910	1.0445
No log	0.1069	162	0.8479	0.3925	0.8479	0.9208
No log	0.1083	164	0.6812	0.3452	0.6812	0.8253
No log	0.1096	166	0.6783	0.3275	0.6783	0.8236
No log	0.1109	168	0.7841	0.3865	0.7841	0.8855
No log	0.1122	170	0.8372	0.4216	0.8372	0.9150
No log	0.1135	172	0.7700	0.4387	0.7700	0.8775
No log	0.1149	174	0.6334	0.4560	0.6334	0.7959
No log	0.1162	176	0.5958	0.4282	0.5958	0.7719
No log	0.1175	178	0.5849	0.4530	0.5849	0.7648
No log	0.1188	180	0.5906	0.5139	0.5906	0.7685
No log	0.1201	182	0.7285	0.5058	0.7285	0.8535
No log	0.1215	184	0.9224	0.4151	0.9224	0.9604
No log	0.1228	186	0.8846	0.4032	0.8846	0.9405
No log	0.1241	188	0.7174	0.3861	0.7174	0.8470
No log	0.1254	190	0.5657	0.4919	0.5657	0.7521
No log	0.1267	192	0.5880	0.4657	0.5880	0.7668
No log	0.1281	194	0.5777	0.4486	0.5777	0.7601
No log	0.1294	196	0.6114	0.4751	0.6114	0.7819
No log	0.1307	198	0.6022	0.4885	0.6022	0.7760
No log	0.1320	200	0.5974	0.4868	0.5974	0.7729
No log	0.1333	202	0.5795	0.5177	0.5795	0.7613
No log	0.1347	204	0.5811	0.4978	0.5811	0.7623
No log	0.1360	206	0.5862	0.4820	0.5862	0.7656
No log	0.1373	208	0.5845	0.4950	0.5845	0.7645
No log	0.1386	210	0.5898	0.4893	0.5898	0.7680
No log	0.1399	212	0.6204	0.4349	0.6204	0.7877
No log	0.1413	214	0.6558	0.4490	0.6558	0.8098
No log	0.1426	216	0.6566	0.4831	0.6566	0.8103
No log	0.1439	218	0.6930	0.4712	0.6930	0.8325
No log	0.1452	220	0.6168	0.5572	0.6168	0.7854
No log	0.1465	222	0.5847	0.5613	0.5847	0.7647
No log	0.1479	224	0.5749	0.5483	0.5749	0.7582
No log	0.1492	226	0.6071	0.5277	0.6071	0.7792
No log	0.1505	228	0.6121	0.4974	0.6121	0.7823
No log	0.1518	230	0.5762	0.4659	0.5762	0.7591
No log	0.1531	232	0.5905	0.4887	0.5905	0.7685
No log	0.1545	234	0.5837	0.4710	0.5837	0.7640
No log	0.1558	236	0.6089	0.4796	0.6089	0.7803
No log	0.1571	238	0.6009	0.4706	0.6009	0.7752
No log	0.1584	240	0.5940	0.4818	0.5940	0.7707
No log	0.1597	242	0.6007	0.5081	0.6007	0.7750
No log	0.1611	244	0.6300	0.4996	0.6300	0.7937
No log	0.1624	246	0.6263	0.5264	0.6263	0.7914
No log	0.1637	248	0.6179	0.5196	0.6179	0.7861
No log	0.1650	250	0.6540	0.5382	0.6540	0.8087
No log	0.1663	252	0.5849	0.5393	0.5849	0.7648
No log	0.1677	254	0.6349	0.5246	0.6349	0.7968
No log	0.1690	256	0.6622	0.4817	0.6622	0.8137
No log	0.1703	258	0.5784	0.4626	0.5784	0.7605
No log	0.1716	260	0.5581	0.4696	0.5581	0.7471
No log	0.1729	262	0.6008	0.4606	0.6008	0.7751
No log	0.1743	264	0.5793	0.4965	0.5793	0.7611
No log	0.1756	266	0.6289	0.4625	0.6289	0.7930
No log	0.1769	268	0.8875	0.4145	0.8875	0.9421
No log	0.1782	270	0.8925	0.4020	0.8925	0.9447
No log	0.1795	272	0.7021	0.4693	0.7021	0.8379
No log	0.1809	274	0.6155	0.4957	0.6155	0.7846
No log	0.1822	276	0.5862	0.5088	0.5862	0.7656
No log	0.1835	278	0.6171	0.4711	0.6171	0.7855
No log	0.1848	280	0.8006	0.4332	0.8006	0.8948
No log	0.1861	282	0.8649	0.4233	0.8649	0.9300
No log	0.1875	284	0.7152	0.4118	0.7152	0.8457
No log	0.1888	286	0.5953	0.4223	0.5953	0.7716
No log	0.1901	288	0.6058	0.4401	0.6058	0.7783
No log	0.1914	290	0.6656	0.4409	0.6656	0.8158
No log	0.1927	292	0.6130	0.4581	0.6130	0.7829
No log	0.1941	294	0.5764	0.4693	0.5764	0.7592
No log	0.1954	296	0.6537	0.4544	0.6537	0.8085
No log	0.1967	298	0.6502	0.4480	0.6502	0.8063
No log	0.1980	300	0.6819	0.4717	0.6819	0.8258
No log	0.1993	302	0.7755	0.4657	0.7755	0.8806
No log	0.2007	304	0.7002	0.4846	0.7002	0.8368
No log	0.2020	306	0.5751	0.5257	0.5751	0.7583
No log	0.2033	308	0.5530	0.5457	0.5530	0.7437
No log	0.2046	310	0.5927	0.5167	0.5927	0.7699
No log	0.2059	312	0.6145	0.5373	0.6145	0.7839
No log	0.2073	314	0.6172	0.5347	0.6172	0.7856
No log	0.2086	316	0.5659	0.5811	0.5659	0.7523
No log	0.2099	318	0.6014	0.5858	0.6014	0.7755
No log	0.2112	320	0.5876	0.6020	0.5876	0.7665
No log	0.2125	322	0.5731	0.6184	0.5731	0.7570
No log	0.2139	324	0.5965	0.5977	0.5965	0.7723
No log	0.2152	326	0.5713	0.6240	0.5713	0.7558
No log	0.2165	328	0.5543	0.6064	0.5543	0.7445
No log	0.2178	330	0.5254	0.6208	0.5254	0.7248
No log	0.2191	332	0.5179	0.5815	0.5179	0.7197
No log	0.2205	334	0.5165	0.5721	0.5165	0.7187
No log	0.2218	336	0.5248	0.5711	0.5248	0.7244
No log	0.2231	338	0.5245	0.5763	0.5245	0.7243
No log	0.2244	340	0.5476	0.5645	0.5476	0.7400
No log	0.2257	342	0.6258	0.5169	0.6258	0.7911
No log	0.2271	344	0.6072	0.5398	0.6072	0.7792
No log	0.2284	346	0.5198	0.6100	0.5198	0.7210
No log	0.2297	348	0.5258	0.5873	0.5258	0.7251
No log	0.2310	350	0.5042	0.6214	0.5042	0.7101
No log	0.2323	352	0.5046	0.5996	0.5046	0.7104
No log	0.2337	354	0.5416	0.5918	0.5416	0.7359
No log	0.2350	356	0.5458	0.5949	0.5458	0.7388
No log	0.2363	358	0.5324	0.6242	0.5324	0.7297
No log	0.2376	360	0.6282	0.5741	0.6282	0.7926
No log	0.2389	362	0.5794	0.6011	0.5794	0.7612
No log	0.2403	364	0.5673	0.6052	0.5673	0.7532
No log	0.2416	366	0.5696	0.6025	0.5696	0.7547
No log	0.2429	368	0.5384	0.6112	0.5384	0.7338
No log	0.2442	370	0.5627	0.6072	0.5627	0.7501
No log	0.2455	372	0.5508	0.6124	0.5508	0.7422
No log	0.2469	374	0.5540	0.6116	0.5540	0.7443
No log	0.2482	376	0.6162	0.5623	0.6162	0.7850
No log	0.2495	378	0.8371	0.4814	0.8371	0.9149
No log	0.2508	380	0.9129	0.4600	0.9129	0.9555
No log	0.2521	382	0.7539	0.4931	0.7539	0.8682
No log	0.2535	384	0.6206	0.5048	0.6206	0.7878
No log	0.2548	386	0.5972	0.4690	0.5972	0.7728
No log	0.2561	388	0.6663	0.4731	0.6663	0.8163
No log	0.2574	390	0.7329	0.4431	0.7329	0.8561
No log	0.2587	392	0.6606	0.4884	0.6606	0.8128
No log	0.2601	394	0.6303	0.4921	0.6303	0.7939
No log	0.2614	396	0.6115	0.4904	0.6115	0.7820
No log	0.2627	398	0.5803	0.5122	0.5803	0.7618
No log	0.2640	400	0.6124	0.5135	0.6124	0.7825
No log	0.2653	402	0.6016	0.5336	0.6016	0.7756
No log	0.2667	404	0.5591	0.5259	0.5591	0.7478
No log	0.2680	406	0.5511	0.5340	0.5511	0.7424
No log	0.2693	408	0.5659	0.5350	0.5659	0.7523
No log	0.2706	410	0.6266	0.5271	0.6266	0.7916
No log	0.2719	412	0.5607	0.5358	0.5607	0.7488
No log	0.2733	414	0.5195	0.5674	0.5195	0.7208
No log	0.2746	416	0.5407	0.5389	0.5407	0.7353
No log	0.2759	418	0.5085	0.5790	0.5085	0.7131
No log	0.2772	420	0.5219	0.5768	0.5219	0.7224
No log	0.2785	422	0.5169	0.5765	0.5169	0.7190
No log	0.2799	424	0.5220	0.5700	0.5220	0.7225
No log	0.2812	426	0.5530	0.5701	0.5530	0.7436
No log	0.2825	428	0.5181	0.5599	0.5181	0.7198
No log	0.2838	430	0.5412	0.5976	0.5412	0.7357
No log	0.2851	432	0.5467	0.5791	0.5467	0.7394
No log	0.2865	434	0.5218	0.5978	0.5218	0.7224
No log	0.2878	436	0.5170	0.5735	0.5170	0.7191
No log	0.2891	438	0.5232	0.5678	0.5232	0.7234
No log	0.2904	440	0.5126	0.5785	0.5126	0.7160
No log	0.2917	442	0.5099	0.5820	0.5099	0.7141
No log	0.2931	444	0.5093	0.6021	0.5093	0.7136
No log	0.2944	446	0.5139	0.6155	0.5139	0.7169
No log	0.2957	448	0.5398	0.6221	0.5398	0.7347
No log	0.2970	450	0.5660	0.6132	0.5660	0.7523
No log	0.2983	452	0.6008	0.6095	0.6008	0.7751
No log	0.2997	454	0.5816	0.5951	0.5816	0.7627
No log	0.3010	456	0.5316	0.6243	0.5316	0.7291
No log	0.3023	458	0.5746	0.5759	0.5746	0.7580
No log	0.3036	460	0.5500	0.6134	0.5500	0.7416
No log	0.3050	462	0.5334	0.6042	0.5334	0.7304
No log	0.3063	464	0.5991	0.5692	0.5991	0.7740
No log	0.3076	466	0.6276	0.5556	0.6276	0.7922
No log	0.3089	468	0.6732	0.5190	0.6732	0.8205
No log	0.3102	470	0.7130	0.4854	0.7130	0.8444
No log	0.3116	472	0.7349	0.4694	0.7349	0.8573
No log	0.3129	474	0.7091	0.4981	0.7091	0.8421
No log	0.3142	476	0.7321	0.4894	0.7321	0.8556
No log	0.3155	478	0.6060	0.5106	0.6060	0.7784
No log	0.3168	480	0.5332	0.5854	0.5332	0.7302
No log	0.3182	482	0.5387	0.5687	0.5387	0.7340
No log	0.3195	484	0.5367	0.5981	0.5367	0.7326
No log	0.3208	486	0.6755	0.5536	0.6755	0.8219
No log	0.3221	488	0.6530	0.5684	0.6530	0.8081
No log	0.3234	490	0.5083	0.5992	0.5083	0.7130
No log	0.3248	492	0.5509	0.5584	0.5509	0.7422
No log	0.3261	494	0.6436	0.5385	0.6436	0.8023
No log	0.3274	496	0.5696	0.5717	0.5696	0.7547
No log	0.3287	498	0.5154	0.6165	0.5154	0.7179
1.0011	0.3300	500	0.6598	0.5655	0.6598	0.8123
1.0011	0.3314	502	0.6716	0.5665	0.6716	0.8195
1.0011	0.3327	504	0.5681	0.5715	0.5681	0.7537
1.0011	0.3340	506	0.5705	0.5477	0.5705	0.7553
1.0011	0.3353	508	0.5916	0.5350	0.5916	0.7692
1.0011	0.3366	510	0.6788	0.4969	0.6788	0.8239
1.0011	0.3380	512	0.8563	0.4853	0.8563	0.9254
1.0011	0.3393	514	0.7856	0.4847	0.7856	0.8863

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1