ASAP_FineTuningBERT_AugV3_k10_task1_organization_fold2

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7996
• Qwk: 0.2876
• Mse: 0.7996
• Rmse: 0.8942

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0017	2	12.3973	0.0	12.3973	3.5210
No log	0.0034	4	10.9248	0.0	10.9248	3.3053
No log	0.0051	6	9.2159	0.0001	9.2159	3.0358
No log	0.0068	8	7.0065	0.0053	7.0065	2.6470
No log	0.0086	10	5.5869	0.0	5.5869	2.3637
No log	0.0103	12	4.3144	0.0069	4.3144	2.0771
No log	0.0120	14	3.1931	0.0489	3.1931	1.7869
No log	0.0137	16	2.2355	0.0078	2.2355	1.4952
No log	0.0154	18	1.7996	0.0	1.7996	1.3415
No log	0.0171	20	1.5108	0.0258	1.5108	1.2291
No log	0.0188	22	1.5989	0.0070	1.5989	1.2645
No log	0.0205	24	2.1710	0.0	2.1710	1.4734
No log	0.0222	26	2.2059	0.0	2.2059	1.4852
No log	0.0240	28	1.5859	0.0018	1.5859	1.2593
No log	0.0257	30	1.4421	0.0685	1.4421	1.2009
No log	0.0274	32	1.7292	0.0	1.7292	1.3150
No log	0.0291	34	1.8855	0.0	1.8855	1.3731
No log	0.0308	36	1.9862	0.0	1.9862	1.4093
No log	0.0325	38	2.1639	0.0	2.1639	1.4710
No log	0.0342	40	2.1454	0.0	2.1454	1.4647
No log	0.0359	42	1.8152	0.0	1.8152	1.3473
No log	0.0376	44	1.6254	0.0	1.6254	1.2749
No log	0.0393	46	1.5756	0.0	1.5756	1.2552
No log	0.0411	48	1.8603	0.0	1.8603	1.3639
No log	0.0428	50	2.2433	0.0	2.2433	1.4978
No log	0.0445	52	2.2187	0.0	2.2187	1.4895
No log	0.0462	54	1.8872	0.0	1.8872	1.3737
No log	0.0479	56	1.8555	0.0	1.8555	1.3622
No log	0.0496	58	1.6798	0.0	1.6798	1.2961
No log	0.0513	60	1.5620	0.0048	1.5620	1.2498
No log	0.0530	62	1.7550	0.0004	1.7550	1.3247
No log	0.0547	64	2.3540	0.0	2.3540	1.5343
No log	0.0565	66	2.4554	0.0	2.4554	1.5670
No log	0.0582	68	1.8781	0.0	1.8781	1.3704
No log	0.0599	70	1.7640	0.0000	1.7640	1.3281
No log	0.0616	72	1.6497	0.0048	1.6497	1.2844
No log	0.0633	74	1.2493	0.1556	1.2493	1.1177
No log	0.0650	76	1.1434	0.1204	1.1434	1.0693
No log	0.0667	78	1.5603	0.0148	1.5603	1.2491
No log	0.0684	80	2.9265	0.0064	2.9265	1.7107
No log	0.0701	82	3.6742	0.0234	3.6742	1.9168
No log	0.0719	84	3.1836	0.0099	3.1836	1.7843
No log	0.0736	86	2.1343	0.0	2.1343	1.4609
No log	0.0753	88	1.5086	0.0149	1.5086	1.2283
No log	0.0770	90	1.3897	0.0636	1.3897	1.1789
No log	0.0787	92	1.3790	0.1033	1.3790	1.1743
No log	0.0804	94	1.3565	0.1284	1.3565	1.1647
No log	0.0821	96	1.7271	0.0065	1.7271	1.3142
No log	0.0838	98	2.0359	0.0	2.0359	1.4269
No log	0.0855	100	1.8884	0.0	1.8884	1.3742
No log	0.0873	102	1.6307	0.0218	1.6307	1.2770
No log	0.0890	104	1.6131	0.0113	1.6131	1.2701
No log	0.0907	106	1.5520	0.0026	1.5520	1.2458
No log	0.0924	108	1.5659	0.0057	1.5658	1.2513
No log	0.0941	110	1.6878	0.0	1.6878	1.2992
No log	0.0958	112	1.7955	0.0	1.7955	1.3400
No log	0.0975	114	2.0769	0.0	2.0769	1.4411
No log	0.0992	116	2.3664	0.0	2.3664	1.5383
No log	0.1009	118	2.7267	0.0	2.7267	1.6513
No log	0.1027	120	2.7864	0.0	2.7864	1.6692
No log	0.1044	122	2.4754	0.0	2.4754	1.5733
No log	0.1061	124	2.0196	0.0	2.0196	1.4211
No log	0.1078	126	1.5124	0.0050	1.5124	1.2298
No log	0.1095	128	1.2274	0.1093	1.2274	1.1079
No log	0.1112	130	1.2623	0.1358	1.2623	1.1235
No log	0.1129	132	1.5836	0.0154	1.5836	1.2584
No log	0.1146	134	1.7439	0.0004	1.7439	1.3206
No log	0.1163	136	1.9506	0.0	1.9506	1.3966
No log	0.1180	138	1.8479	0.0	1.8479	1.3594
No log	0.1198	140	1.5338	0.0146	1.5338	1.2384
No log	0.1215	142	1.3680	0.0959	1.3680	1.1696
No log	0.1232	144	1.1350	0.0870	1.1350	1.0653
No log	0.1249	146	1.0707	0.0800	1.0707	1.0347
No log	0.1266	148	1.1321	0.0931	1.1321	1.0640
No log	0.1283	150	1.2348	0.0821	1.2348	1.1112
No log	0.1300	152	1.3266	0.0729	1.3266	1.1518
No log	0.1317	154	1.3166	0.0702	1.3166	1.1474
No log	0.1334	156	1.3693	0.0771	1.3693	1.1702
No log	0.1352	158	1.3061	0.0742	1.3061	1.1428
No log	0.1369	160	1.2008	0.0823	1.2008	1.0958
No log	0.1386	162	1.0994	0.0870	1.0994	1.0485
No log	0.1403	164	1.0468	0.0896	1.0468	1.0231
No log	0.1420	166	1.0178	0.0838	1.0178	1.0089
No log	0.1437	168	0.9914	0.0909	0.9914	0.9957
No log	0.1454	170	0.9351	0.0838	0.9351	0.9670
No log	0.1471	172	0.9054	0.0816	0.9054	0.9515
No log	0.1488	174	0.9762	0.0870	0.9762	0.9881
No log	0.1506	176	1.0447	0.0855	1.0447	1.0221
No log	0.1523	178	1.0232	0.0914	1.0232	1.0115
No log	0.1540	180	0.9329	0.0896	0.9329	0.9659
No log	0.1557	182	0.8866	0.0816	0.8866	0.9416
No log	0.1574	184	0.8818	0.0816	0.8818	0.9390
No log	0.1591	186	0.8487	0.0816	0.8487	0.9212
No log	0.1608	188	0.8265	0.0816	0.8265	0.9091
No log	0.1625	190	0.8342	0.0816	0.8342	0.9134
No log	0.1642	192	0.8466	0.0816	0.8466	0.9201
No log	0.1660	194	0.8533	0.0816	0.8533	0.9238
No log	0.1677	196	0.8899	0.0838	0.8899	0.9433
No log	0.1694	198	1.0057	0.0889	1.0057	1.0028
No log	0.1711	200	1.1352	0.0911	1.1352	1.0654
No log	0.1728	202	1.1112	0.0902	1.1112	1.0541
No log	0.1745	204	0.8474	0.0816	0.8474	0.9206
No log	0.1762	206	0.7806	0.0816	0.7806	0.8835
No log	0.1779	208	0.7919	0.0816	0.7919	0.8899
No log	0.1796	210	0.7804	0.0816	0.7804	0.8834
No log	0.1814	212	0.7737	0.0816	0.7737	0.8796
No log	0.1831	214	0.7765	0.0816	0.7765	0.8812
No log	0.1848	216	0.7728	0.0816	0.7728	0.8791
No log	0.1865	218	0.7820	0.0816	0.7820	0.8843
No log	0.1882	220	0.8265	0.0816	0.8265	0.9091
No log	0.1899	222	1.0143	0.0716	1.0143	1.0071
No log	0.1916	224	1.8530	-0.0083	1.8530	1.3613
No log	0.1933	226	4.7318	-0.0223	4.7318	2.1753
No log	0.1950	228	3.5433	0.0015	3.5433	1.8824
No log	0.1967	230	1.6088	0.0048	1.6088	1.2684
No log	0.1985	232	0.9883	0.0861	0.9883	0.9941
No log	0.2002	234	0.8563	0.0816	0.8563	0.9254
No log	0.2019	236	0.8248	0.0816	0.8248	0.9082
No log	0.2036	238	0.8266	0.0816	0.8266	0.9092
No log	0.2053	240	0.8215	0.0816	0.8215	0.9064
No log	0.2070	242	0.8109	0.0816	0.8109	0.9005
No log	0.2087	244	0.8022	0.0806	0.8022	0.8957
No log	0.2104	246	0.8007	0.0813	0.8007	0.8948
No log	0.2121	248	0.7959	0.0690	0.7959	0.8921
No log	0.2139	250	0.7790	0.0800	0.7790	0.8826
No log	0.2156	252	0.7680	0.0806	0.7680	0.8764
No log	0.2173	254	0.7677	0.0816	0.7677	0.8762
No log	0.2190	256	0.7801	0.0816	0.7801	0.8832
No log	0.2207	258	0.7925	0.0816	0.7925	0.8902
No log	0.2224	260	0.7814	0.0816	0.7814	0.8840
No log	0.2241	262	0.7660	0.0816	0.7660	0.8752
No log	0.2258	264	0.7579	0.0816	0.7579	0.8706
No log	0.2275	266	0.7511	0.0816	0.7511	0.8666
No log	0.2293	268	0.7482	0.0816	0.7482	0.8650
No log	0.2310	270	0.7503	0.0816	0.7503	0.8662
No log	0.2327	272	0.7612	0.0828	0.7612	0.8725
No log	0.2344	274	0.7760	0.0698	0.7760	0.8809
No log	0.2361	276	0.7939	0.1378	0.7939	0.8910
No log	0.2378	278	0.7742	0.0732	0.7742	0.8799
No log	0.2395	280	0.8773	0.0828	0.8773	0.9367
No log	0.2412	282	1.2026	0.0796	1.2026	1.0966
No log	0.2429	284	1.3585	0.0636	1.3585	1.1656
No log	0.2447	286	1.3806	0.0676	1.3806	1.1750
No log	0.2464	288	1.1161	0.1046	1.1161	1.0564
No log	0.2481	290	1.1031	0.1069	1.1031	1.0503
No log	0.2498	292	1.0649	0.0865	1.0649	1.0320
No log	0.2515	294	0.9035	0.0816	0.9035	0.9505
No log	0.2532	296	0.8226	0.0816	0.8226	0.9070
No log	0.2549	298	0.8220	0.0816	0.8220	0.9066
No log	0.2566	300	0.8109	0.0816	0.8109	0.9005
No log	0.2583	302	0.8018	0.0816	0.8018	0.8954
No log	0.2601	304	0.7980	0.0816	0.7980	0.8933
No log	0.2618	306	0.8008	0.0816	0.8008	0.8949
No log	0.2635	308	0.8099	0.0816	0.8099	0.9000
No log	0.2652	310	0.8446	0.0816	0.8446	0.9190
No log	0.2669	312	0.8784	0.0816	0.8784	0.9372
No log	0.2686	314	0.9250	0.0806	0.9250	0.9618
No log	0.2703	316	1.0292	0.0687	1.0292	1.0145
No log	0.2720	318	1.1771	0.0173	1.1771	1.0849
No log	0.2737	320	1.3220	0.0230	1.3220	1.1498
No log	0.2754	322	1.4032	0.0086	1.4032	1.1846
No log	0.2772	324	1.4165	0.0074	1.4165	1.1902
No log	0.2789	326	1.2344	0.0407	1.2344	1.1110
No log	0.2806	328	0.8463	0.0816	0.8463	0.9200
No log	0.2823	330	0.7708	0.0816	0.7708	0.8779
No log	0.2840	332	0.7703	0.0816	0.7703	0.8777
No log	0.2857	334	0.7812	0.0816	0.7812	0.8838
No log	0.2874	336	0.7901	0.0816	0.7901	0.8889
No log	0.2891	338	0.8079	0.0816	0.8079	0.8988
No log	0.2908	340	0.8042	0.0816	0.8042	0.8968
No log	0.2926	342	0.7901	0.0816	0.7901	0.8889
No log	0.2943	344	0.7875	0.0816	0.7875	0.8874
No log	0.2960	346	0.7945	0.0816	0.7945	0.8913
No log	0.2977	348	0.8418	0.0816	0.8418	0.9175
No log	0.2994	350	1.1092	0.0343	1.1092	1.0532
No log	0.3011	352	1.8509	0.0075	1.8509	1.3605
No log	0.3028	354	1.2741	0.0323	1.2741	1.1288
No log	0.3045	356	0.8951	0.1051	0.8951	0.9461
No log	0.3062	358	0.7649	0.0730	0.7649	0.8746
No log	0.3080	360	0.7845	0.2710	0.7845	0.8857
No log	0.3097	362	0.8066	0.3794	0.8066	0.8981
No log	0.3114	364	0.7978	0.3187	0.7978	0.8932
No log	0.3131	366	0.7803	0.0890	0.7803	0.8833
No log	0.3148	368	0.7832	0.0816	0.7832	0.8850
No log	0.3165	370	0.7903	0.0816	0.7903	0.8890
No log	0.3182	372	0.7744	0.1010	0.7744	0.8800
No log	0.3199	374	0.7878	0.3049	0.7878	0.8876
No log	0.3216	376	0.8130	0.3171	0.8130	0.9017
No log	0.3234	378	0.8316	0.2773	0.8316	0.9119
No log	0.3251	380	0.8454	0.2227	0.8454	0.9195
No log	0.3268	382	0.8382	0.1254	0.8382	0.9155
No log	0.3285	384	0.8419	0.0811	0.8419	0.9176
No log	0.3302	386	0.8463	0.0926	0.8463	0.9199
No log	0.3319	388	0.8374	0.0918	0.8374	0.9151
No log	0.3336	390	0.8389	0.1301	0.8389	0.9159
No log	0.3353	392	0.8481	0.1621	0.8481	0.9209
No log	0.3370	394	0.8713	0.2236	0.8713	0.9334
No log	0.3388	396	0.8802	0.1861	0.8802	0.9382
No log	0.3405	398	0.8720	0.1648	0.8720	0.9338
No log	0.3422	400	0.8698	0.1488	0.8698	0.9326
No log	0.3439	402	0.8522	0.0871	0.8522	0.9232
No log	0.3456	404	0.9521	0.0558	0.9521	0.9758
No log	0.3473	406	1.5826	-0.0228	1.5826	1.2580
No log	0.3490	408	2.5949	-0.0069	2.5949	1.6109
No log	0.3507	410	3.2582	-0.0083	3.2582	1.8050
No log	0.3524	412	3.9067	-0.0119	3.9067	1.9765
No log	0.3541	414	3.3156	0.0102	3.3156	1.8209
No log	0.3559	416	2.6830	0.0005	2.6830	1.6380
No log	0.3576	418	1.7986	0.0069	1.7986	1.3411
No log	0.3593	420	1.0151	0.0941	1.0151	1.0075
No log	0.3610	422	0.7846	0.0838	0.7846	0.8858
No log	0.3627	424	0.7449	0.1009	0.7449	0.8631
No log	0.3644	426	0.7844	0.3661	0.7844	0.8856
No log	0.3661	428	0.8477	0.2832	0.8477	0.9207
No log	0.3678	430	0.8579	0.2668	0.8579	0.9262
No log	0.3695	432	0.7919	0.3143	0.7919	0.8899
No log	0.3713	434	0.7540	0.1459	0.7540	0.8683
No log	0.3730	436	0.7544	0.0816	0.7544	0.8685
No log	0.3747	438	0.7596	0.0816	0.7596	0.8715
No log	0.3764	440	0.7408	0.0816	0.7408	0.8607
No log	0.3781	442	0.7345	0.0816	0.7345	0.8571
No log	0.3798	444	0.7313	0.0861	0.7313	0.8552
No log	0.3815	446	0.7280	0.0816	0.7280	0.8532
No log	0.3832	448	0.7337	0.0816	0.7337	0.8565
No log	0.3849	450	0.7355	0.0816	0.7355	0.8576
No log	0.3867	452	0.7501	0.0816	0.7501	0.8661
No log	0.3884	454	0.7637	0.0816	0.7637	0.8739
No log	0.3901	456	0.8334	0.0816	0.8334	0.9129
No log	0.3918	458	0.8249	0.0873	0.8249	0.9083
No log	0.3935	460	0.7661	0.0816	0.7661	0.8753
No log	0.3952	462	0.7207	0.0816	0.7207	0.8489
No log	0.3969	464	0.7185	0.0883	0.7185	0.8477
No log	0.3986	466	0.7419	0.2083	0.7419	0.8613
No log	0.4003	468	0.7555	0.2872	0.7555	0.8692
No log	0.4021	470	0.7686	0.4059	0.7686	0.8767
No log	0.4038	472	0.7753	0.4205	0.7753	0.8805
No log	0.4055	474	0.7831	0.4166	0.7831	0.8849
No log	0.4072	476	0.7574	0.3739	0.7574	0.8703
No log	0.4089	478	0.7367	0.0986	0.7367	0.8583
No log	0.4106	480	0.7352	0.0861	0.7352	0.8574
No log	0.4123	482	0.7370	0.1853	0.7370	0.8585
No log	0.4140	484	0.7884	0.4064	0.7884	0.8879
No log	0.4157	486	0.8254	0.2908	0.8254	0.9085
No log	0.4175	488	0.8393	0.2761	0.8393	0.9162
No log	0.4192	490	0.8307	0.3090	0.8307	0.9114
No log	0.4209	492	0.7976	0.3201	0.7976	0.8931
No log	0.4226	494	0.7843	0.3883	0.7843	0.8856
No log	0.4243	496	0.7754	0.3791	0.7754	0.8805
No log	0.4260	498	0.7712	0.3368	0.7712	0.8782
1.4924	0.4277	500	0.7787	0.3521	0.7787	0.8824
1.4924	0.4294	502	0.7910	0.3632	0.7910	0.8894
1.4924	0.4311	504	0.8097	0.3025	0.8097	0.8998
1.4924	0.4328	506	0.8134	0.3105	0.8134	0.9019
1.4924	0.4346	508	0.8175	0.2974	0.8175	0.9041
1.4924	0.4363	510	0.8108	0.2655	0.8108	0.9004
1.4924	0.4380	512	0.7996	0.2876	0.7996	0.8942

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1