ASAP_FineTuningBERT_AugV3_k10_task1_organization_fold0

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7460
• Qwk: 0.0746
• Mse: 0.7460
• Rmse: 0.8637

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0018	2	9.6794	0.0	9.6794	3.1112
No log	0.0035	4	8.1510	0.0161	8.1510	2.8550
No log	0.0053	6	7.1530	0.0054	7.1530	2.6745
No log	0.0070	8	6.4174	0.0018	6.4174	2.5333
No log	0.0088	10	5.5507	0.0	5.5507	2.3560
No log	0.0105	12	4.6493	0.0	4.6493	2.1562
No log	0.0123	14	3.8575	0.0443	3.8575	1.9641
No log	0.0140	16	3.0656	0.0139	3.0656	1.7509
No log	0.0158	18	2.4432	0.0115	2.4432	1.5631
No log	0.0176	20	2.0432	0.0077	2.0432	1.4294
No log	0.0193	22	2.2035	0.0039	2.2035	1.4844
No log	0.0211	24	2.4704	0.0	2.4704	1.5718
No log	0.0228	26	2.7602	0.0	2.7602	1.6614
No log	0.0246	28	2.0300	0.0	2.0300	1.4248
No log	0.0263	30	1.3376	0.1359	1.3376	1.1566
No log	0.0281	32	1.5183	0.0467	1.5183	1.2322
No log	0.0299	34	3.0646	0.0061	3.0646	1.7506
No log	0.0316	36	3.5499	0.0390	3.5499	1.8841
No log	0.0334	38	2.8374	0.0077	2.8374	1.6844
No log	0.0351	40	1.8297	0.0039	1.8297	1.3526
No log	0.0369	42	1.5418	0.0073	1.5418	1.2417
No log	0.0386	44	1.6809	0.0039	1.6809	1.2965
No log	0.0404	46	2.1708	0.0039	2.1708	1.4734
No log	0.0421	48	2.8689	0.0077	2.8689	1.6938
No log	0.0439	50	3.3624	0.0164	3.3624	1.8337
No log	0.0457	52	3.3628	0.0139	3.3628	1.8338
No log	0.0474	54	2.9596	0.0077	2.9596	1.7204
No log	0.0492	56	2.4223	0.0039	2.4223	1.5564
No log	0.0509	58	2.3046	0.0039	2.3046	1.5181
No log	0.0527	60	2.1607	0.0	2.1607	1.4699
No log	0.0544	62	2.0520	0.0	2.0520	1.4325
No log	0.0562	64	2.2045	0.0	2.2045	1.4848
No log	0.0579	66	2.5258	0.0	2.5258	1.5893
No log	0.0597	68	2.8073	0.0039	2.8073	1.6755
No log	0.0615	70	2.8228	0.0	2.8228	1.6801
No log	0.0632	72	2.5211	0.0	2.5211	1.5878
No log	0.0650	74	2.2152	0.0	2.2152	1.4884
No log	0.0667	76	2.0504	0.0	2.0504	1.4319
No log	0.0685	78	2.0477	0.0	2.0477	1.4310
No log	0.0702	80	1.9609	0.0	1.9609	1.4003
No log	0.0720	82	1.9011	0.0	1.9011	1.3788
No log	0.0737	84	1.9883	0.0	1.9883	1.4101
No log	0.0755	86	2.3075	0.0	2.3075	1.5190
No log	0.0773	88	2.6210	0.0	2.6210	1.6189
No log	0.0790	90	2.6970	0.0	2.6970	1.6422
No log	0.0808	92	2.4523	0.0	2.4523	1.5660
No log	0.0825	94	2.1335	0.0	2.1335	1.4606
No log	0.0843	96	2.0361	0.0	2.0361	1.4269
No log	0.0860	98	2.0502	0.0	2.0502	1.4319
No log	0.0878	100	2.0495	0.0	2.0495	1.4316
No log	0.0896	102	2.1851	0.0	2.1851	1.4782
No log	0.0913	104	2.3847	0.0	2.3847	1.5442
No log	0.0931	106	2.4854	0.0	2.4854	1.5765
No log	0.0948	108	2.5058	0.0	2.5058	1.5830
No log	0.0966	110	2.3833	0.0	2.3833	1.5438
No log	0.0983	112	2.3352	0.0	2.3352	1.5281
No log	0.1001	114	2.2179	0.0	2.2179	1.4893
No log	0.1018	116	1.9903	0.0	1.9903	1.4108
No log	0.1036	118	1.8947	0.0	1.8947	1.3765
No log	0.1054	120	1.9560	0.0	1.9560	1.3986
No log	0.1071	122	2.0101	0.0	2.0101	1.4178
No log	0.1089	124	2.1371	0.0	2.1371	1.4619
No log	0.1106	126	2.1464	0.0	2.1464	1.4651
No log	0.1124	128	2.0460	0.0	2.0460	1.4304
No log	0.1141	130	1.9701	0.0	1.9701	1.4036
No log	0.1159	132	2.0001	0.0	2.0001	1.4143
No log	0.1176	134	1.9645	0.0	1.9645	1.4016
No log	0.1194	136	2.0529	0.0	2.0529	1.4328
No log	0.1212	138	2.0109	0.0	2.0109	1.4181
No log	0.1229	140	1.7830	0.0	1.7830	1.3353
No log	0.1247	142	1.6435	0.0	1.6435	1.2820
No log	0.1264	144	1.6325	0.0	1.6325	1.2777
No log	0.1282	146	1.7247	0.0	1.7247	1.3133
No log	0.1299	148	1.8016	0.0	1.8016	1.3422
No log	0.1317	150	1.8890	0.0	1.8890	1.3744
No log	0.1335	152	1.8238	0.0	1.8238	1.3505
No log	0.1352	154	1.6210	0.0003	1.6210	1.2732
No log	0.1370	156	1.5331	0.0086	1.5331	1.2382
No log	0.1387	158	1.4814	0.0152	1.4814	1.2171
No log	0.1405	160	1.4865	0.0101	1.4865	1.2192
No log	0.1422	162	1.5267	0.0080	1.5267	1.2356
No log	0.1440	164	1.4948	0.0187	1.4948	1.2226
No log	0.1457	166	1.4704	0.0239	1.4704	1.2126
No log	0.1475	168	1.4909	0.0186	1.4909	1.2210
No log	0.1493	170	1.4346	0.0632	1.4346	1.1978
No log	0.1510	172	1.4002	0.0804	1.4002	1.1833
No log	0.1528	174	1.4342	0.0594	1.4342	1.1976
No log	0.1545	176	1.5107	-0.0180	1.5107	1.2291
No log	0.1563	178	1.5500	-0.0012	1.5500	1.2450
No log	0.1580	180	1.5998	-0.0002	1.5998	1.2648
No log	0.1598	182	1.5832	-0.0013	1.5832	1.2583
No log	0.1615	184	1.5817	-0.0035	1.5817	1.2577
No log	0.1633	186	1.5508	-0.0033	1.5508	1.2453
No log	0.1651	188	1.5575	-0.0059	1.5575	1.2480
No log	0.1668	190	1.5486	-0.0118	1.5486	1.2444
No log	0.1686	192	1.4311	0.0525	1.4311	1.1963
No log	0.1703	194	1.4060	0.0579	1.4060	1.1857
No log	0.1721	196	1.4447	0.0412	1.4447	1.2019
No log	0.1738	198	1.4143	0.0489	1.4143	1.1892
No log	0.1756	200	1.3293	0.0787	1.3293	1.1529
No log	0.1773	202	1.2151	0.0685	1.2151	1.1023
No log	0.1791	204	1.2006	0.0707	1.2006	1.0957
No log	0.1809	206	1.2015	0.0707	1.2015	1.0961
No log	0.1826	208	1.1611	0.0722	1.1611	1.0775
No log	0.1844	210	1.1030	0.0701	1.1030	1.0502
No log	0.1861	212	1.1293	0.0746	1.1293	1.0627
No log	0.1879	214	1.1958	0.0615	1.1958	1.0935
No log	0.1896	216	1.2253	0.0762	1.2253	1.1069
No log	0.1914	218	1.1708	0.0757	1.1708	1.0820
No log	0.1932	220	1.1413	0.0629	1.1413	1.0683
No log	0.1949	222	1.1824	0.0552	1.1824	1.0874
No log	0.1967	224	1.3161	0.0440	1.3161	1.1472
No log	0.1984	226	1.3897	0.0039	1.3897	1.1788
No log	0.2002	228	1.2793	0.0399	1.2793	1.1311
No log	0.2019	230	0.9857	0.0746	0.9857	0.9928
No log	0.2037	232	0.9338	0.0746	0.9338	0.9663
No log	0.2054	234	0.9679	0.0746	0.9679	0.9838
No log	0.2072	236	1.0141	0.0746	1.0141	1.0070
No log	0.2090	238	1.0277	0.0746	1.0277	1.0138
No log	0.2107	240	1.0048	0.0746	1.0048	1.0024
No log	0.2125	242	1.0033	0.0746	1.0033	1.0016
No log	0.2142	244	0.9700	0.0746	0.9700	0.9849
No log	0.2160	246	0.9817	0.0746	0.9817	0.9908
No log	0.2177	248	0.9404	0.0746	0.9404	0.9697
No log	0.2195	250	0.8713	0.0746	0.8713	0.9334
No log	0.2212	252	0.8516	0.0746	0.8516	0.9228
No log	0.2230	254	0.8364	0.0746	0.8364	0.9145
No log	0.2248	256	0.8392	0.0746	0.8392	0.9161
No log	0.2265	258	0.8358	0.0746	0.8358	0.9142
No log	0.2283	260	0.8354	0.0746	0.8354	0.9140
No log	0.2300	262	0.8488	0.0746	0.8488	0.9213
No log	0.2318	264	0.8727	0.0746	0.8727	0.9342
No log	0.2335	266	0.8595	0.0746	0.8595	0.9271
No log	0.2353	268	0.8516	0.0746	0.8516	0.9228
No log	0.2371	270	0.8543	0.0746	0.8543	0.9243
No log	0.2388	272	0.8425	0.0746	0.8425	0.9179
No log	0.2406	274	0.8120	0.0746	0.8120	0.9011
No log	0.2423	276	0.7886	0.0746	0.7886	0.8880
No log	0.2441	278	0.7649	0.0803	0.7649	0.8746
No log	0.2458	280	0.7594	0.0595	0.7594	0.8714
No log	0.2476	282	0.7630	0.0656	0.7630	0.8735
No log	0.2493	284	0.7677	0.0731	0.7677	0.8762
No log	0.2511	286	0.8068	0.0746	0.8068	0.8982
No log	0.2529	288	0.8738	0.0783	0.8738	0.9347
No log	0.2546	290	0.9006	0.0841	0.9006	0.9490
No log	0.2564	292	0.8847	0.0783	0.8847	0.9406
No log	0.2581	294	0.8329	0.0746	0.8329	0.9126
No log	0.2599	296	0.8057	0.0792	0.8057	0.8976
No log	0.2616	298	0.8095	0.0803	0.8095	0.8997
No log	0.2634	300	0.8125	0.0746	0.8125	0.9014
No log	0.2651	302	0.8387	0.0746	0.8387	0.9158
No log	0.2669	304	0.8295	0.0746	0.8295	0.9108
No log	0.2687	306	0.8511	0.0746	0.8511	0.9226
No log	0.2704	308	0.8060	0.0746	0.8060	0.8978
No log	0.2722	310	0.7751	0.0746	0.7751	0.8804
No log	0.2739	312	0.7608	0.0746	0.7608	0.8722
No log	0.2757	314	0.7564	0.0757	0.7564	0.8697
No log	0.2774	316	0.7569	0.0803	0.7569	0.8700
No log	0.2792	318	0.7608	0.0803	0.7608	0.8722
No log	0.2809	320	0.7736	0.0746	0.7736	0.8796
No log	0.2827	322	0.7893	0.0746	0.7893	0.8884
No log	0.2845	324	0.8653	0.0746	0.8653	0.9302
No log	0.2862	326	0.9617	0.0746	0.9617	0.9807
No log	0.2880	328	0.9895	0.0736	0.9895	0.9948
No log	0.2897	330	0.9005	0.0746	0.9005	0.9489
No log	0.2915	332	0.8291	0.0746	0.8291	0.9105
No log	0.2932	334	0.8039	0.0746	0.8039	0.8966
No log	0.2950	336	0.7948	0.0746	0.7948	0.8915
No log	0.2968	338	0.7953	0.0746	0.7953	0.8918
No log	0.2985	340	0.7935	0.0746	0.7935	0.8908
No log	0.3003	342	0.8176	0.0746	0.8176	0.9042
No log	0.3020	344	0.8281	0.0746	0.8281	0.9100
No log	0.3038	346	0.8357	0.0746	0.8357	0.9142
No log	0.3055	348	0.8713	0.0746	0.8713	0.9334
No log	0.3073	350	0.9361	0.0746	0.9361	0.9675
No log	0.3090	352	1.0714	0.0725	1.0714	1.0351
No log	0.3108	354	1.2899	0.0699	1.2899	1.1358
No log	0.3126	356	1.4150	0.0352	1.4150	1.1895
No log	0.3143	358	1.2151	0.0769	1.2151	1.1023
No log	0.3161	360	1.0999	0.0663	1.0999	1.0488
No log	0.3178	362	0.9251	0.0746	0.9251	0.9618
No log	0.3196	364	0.8172	0.0746	0.8172	0.9040
No log	0.3213	366	0.7890	0.0746	0.7890	0.8883
No log	0.3231	368	0.7784	0.0746	0.7784	0.8823
No log	0.3248	370	0.7696	0.0746	0.7696	0.8773
No log	0.3266	372	0.7642	0.0746	0.7642	0.8742
No log	0.3284	374	0.7648	0.0746	0.7648	0.8745
No log	0.3301	376	0.7672	0.0746	0.7672	0.8759
No log	0.3319	378	0.7743	0.0746	0.7743	0.8800
No log	0.3336	380	0.7816	0.0746	0.7816	0.8841
No log	0.3354	382	0.7785	0.0746	0.7785	0.8823
No log	0.3371	384	0.7869	0.0746	0.7869	0.8871
No log	0.3389	386	0.7752	0.0757	0.7752	0.8805
No log	0.3406	388	0.7806	0.0757	0.7806	0.8835
No log	0.3424	390	0.7982	0.0746	0.7982	0.8934
No log	0.3442	392	0.8312	0.0746	0.8312	0.9117
No log	0.3459	394	0.9668	0.0746	0.9668	0.9832
No log	0.3477	396	1.1300	0.0746	1.1300	1.0630
No log	0.3494	398	1.2405	0.0591	1.2405	1.1138
No log	0.3512	400	1.1349	0.0746	1.1349	1.0653
No log	0.3529	402	1.0576	0.0792	1.0576	1.0284
No log	0.3547	404	1.0184	0.0436	1.0184	1.0092
No log	0.3565	406	0.9556	0.0409	0.9556	0.9776
No log	0.3582	408	0.9138	0.0436	0.9138	0.9559
No log	0.3600	410	0.9007	0.0803	0.9007	0.9490
No log	0.3617	412	0.9237	0.0746	0.9237	0.9611
No log	0.3635	414	0.9897	0.0746	0.9897	0.9948
No log	0.3652	416	1.0109	0.0840	1.0109	1.0054
No log	0.3670	418	0.9875	0.0840	0.9875	0.9937
No log	0.3687	420	0.9129	0.0746	0.9129	0.9555
No log	0.3705	422	0.8432	0.0746	0.8432	0.9183
No log	0.3723	424	0.8022	0.0746	0.8022	0.8957
No log	0.3740	426	0.7632	0.0746	0.7632	0.8736
No log	0.3758	428	0.7265	0.0746	0.7265	0.8523
No log	0.3775	430	0.7174	0.0746	0.7174	0.8470
No log	0.3793	432	0.7251	0.0798	0.7251	0.8515
No log	0.3810	434	0.7317	0.1040	0.7317	0.8554
No log	0.3828	436	0.7213	0.1594	0.7213	0.8493
No log	0.3845	438	0.7079	0.1640	0.7079	0.8414
No log	0.3863	440	0.7065	0.1279	0.7065	0.8405
No log	0.3881	442	0.7052	0.1422	0.7052	0.8398
No log	0.3898	444	0.7065	0.1359	0.7065	0.8405
No log	0.3916	446	0.7089	0.1733	0.7089	0.8420
No log	0.3933	448	0.7190	0.2624	0.7190	0.8480
No log	0.3951	450	0.7372	0.3065	0.7372	0.8586
No log	0.3968	452	0.7624	0.3220	0.7624	0.8732
No log	0.3986	454	0.7761	0.2212	0.7761	0.8810
No log	0.4004	456	0.7809	0.1150	0.7809	0.8837
No log	0.4021	458	0.7773	0.0880	0.7773	0.8816
No log	0.4039	460	0.7753	0.0902	0.7753	0.8805
No log	0.4056	462	0.7717	0.0805	0.7717	0.8785
No log	0.4074	464	0.7821	0.0805	0.7821	0.8843
No log	0.4091	466	0.7884	0.0794	0.7884	0.8879
No log	0.4109	468	0.8003	0.0817	0.8003	0.8946
No log	0.4126	470	0.8139	0.0794	0.8139	0.9021
No log	0.4144	472	0.7907	0.0736	0.7907	0.8892
No log	0.4162	474	0.7870	0.0841	0.7870	0.8872
No log	0.4179	476	0.7076	0.0841	0.7076	0.8412
No log	0.4197	478	0.6763	0.0931	0.6763	0.8224
No log	0.4214	480	0.6564	0.1341	0.6564	0.8102
No log	0.4232	482	0.6578	0.1217	0.6578	0.8110
No log	0.4249	484	0.6620	0.1759	0.6620	0.8136
No log	0.4267	486	0.6750	0.2136	0.6750	0.8216
No log	0.4284	488	0.6954	0.1014	0.6954	0.8339
No log	0.4302	490	0.7030	0.1119	0.7030	0.8384
No log	0.4320	492	0.7025	0.2200	0.7025	0.8381
No log	0.4337	494	0.7009	0.2840	0.7009	0.8372
No log	0.4355	496	0.7028	0.2867	0.7028	0.8383
No log	0.4372	498	0.7087	0.2634	0.7087	0.8418
1.4684	0.4390	500	0.7160	0.1765	0.7160	0.8462
1.4684	0.4407	502	0.7273	0.0773	0.7273	0.8528
1.4684	0.4425	504	0.7567	0.0746	0.7567	0.8699
1.4684	0.4442	506	0.7706	0.0746	0.7706	0.8778
1.4684	0.4460	508	0.7531	0.0746	0.7531	0.8678
1.4684	0.4478	510	0.7460	0.0746	0.7460	0.8637

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1