ASAP_FineTuningBERT_AugV3_k5_task1_organization_fold2

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0421
• Qwk: 0.3192
• Mse: 1.0421
• Rmse: 1.0209

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0033	2	10.0160	0.0	10.0160	3.1648
No log	0.0067	4	9.2664	0.0	9.2664	3.0441
No log	0.0100	6	8.9136	-0.0005	8.9136	2.9856
No log	0.0133	8	8.4987	-0.0147	8.4987	2.9153
No log	0.0166	10	7.8980	0.0	7.8980	2.8103
No log	0.0200	12	7.1229	0.0	7.1229	2.6689
No log	0.0233	14	6.2600	0.0	6.2600	2.5020
No log	0.0266	16	5.6337	0.0	5.6337	2.3736
No log	0.0300	18	4.7956	0.0	4.7956	2.1899
No log	0.0333	20	4.0319	-0.0001	4.0319	2.0080
No log	0.0366	22	3.3613	0.0175	3.3613	1.8334
No log	0.0399	24	2.8232	0.0064	2.8232	1.6802
No log	0.0433	26	2.2804	0.0	2.2804	1.5101
No log	0.0466	28	1.9000	0.0	1.9000	1.3784
No log	0.0499	30	1.7084	0.0	1.7084	1.3071
No log	0.0532	32	1.4696	-0.0007	1.4696	1.2123
No log	0.0566	34	1.6857	0.0	1.6857	1.2984
No log	0.0599	36	1.6178	0.0	1.6178	1.2719
No log	0.0632	38	1.6695	-0.0011	1.6695	1.2921
No log	0.0666	40	1.8583	0.0	1.8583	1.3632
No log	0.0699	42	1.6054	-0.0021	1.6054	1.2671
No log	0.0732	44	1.5426	0.0067	1.5426	1.2420
No log	0.0765	46	1.5380	0.0079	1.5380	1.2401
No log	0.0799	48	1.9270	0.0	1.9270	1.3882
No log	0.0832	50	1.9988	0.0	1.9988	1.4138
No log	0.0865	52	1.8213	0.0	1.8213	1.3496
No log	0.0899	54	1.7850	0.0	1.7850	1.3360
No log	0.0932	56	1.9274	0.0	1.9274	1.3883
No log	0.0965	58	2.4224	0.0	2.4224	1.5564
No log	0.0998	60	2.4663	0.0	2.4663	1.5705
No log	0.1032	62	1.9985	0.0	1.9986	1.4137
No log	0.1065	64	1.6644	0.0004	1.6644	1.2901
No log	0.1098	66	1.5274	0.0041	1.5274	1.2359
No log	0.1131	68	1.5848	-0.0003	1.5848	1.2589
No log	0.1165	70	1.8226	0.0	1.8226	1.3500
No log	0.1198	72	2.2299	0.0	2.2299	1.4933
No log	0.1231	74	2.1845	0.0	2.1845	1.4780
No log	0.1265	76	2.0099	0.0	2.0099	1.4177
No log	0.1298	78	1.9112	0.0	1.9112	1.3825
No log	0.1331	80	1.8782	0.0	1.8782	1.3705
No log	0.1364	82	1.8401	0.0	1.8401	1.3565
No log	0.1398	84	1.7371	0.0	1.7371	1.3180
No log	0.1431	86	1.7829	0.0	1.7829	1.3352
No log	0.1464	88	1.8913	0.0	1.8913	1.3753
No log	0.1498	90	2.2342	0.0	2.2342	1.4947
No log	0.1531	92	2.3564	0.0	2.3564	1.5351
No log	0.1564	94	2.2127	0.0	2.2127	1.4875
No log	0.1597	96	1.9679	0.0	1.9679	1.4028
No log	0.1631	98	1.7278	0.0	1.7278	1.3144
No log	0.1664	100	1.5759	0.0	1.5759	1.2553
No log	0.1697	102	1.4786	-0.0014	1.4786	1.2160
No log	0.1730	104	1.5064	0.0015	1.5064	1.2274
No log	0.1764	106	1.6643	0.0	1.6643	1.2901
No log	0.1797	108	1.7994	0.0	1.7994	1.3414
No log	0.1830	110	1.6966	0.0	1.6966	1.3026
No log	0.1864	112	1.5021	0.0064	1.5021	1.2256
No log	0.1897	114	1.6130	-0.0024	1.6130	1.2701
No log	0.1930	116	1.5812	-0.0074	1.5812	1.2575
No log	0.1963	118	1.5076	-0.0088	1.5076	1.2279
No log	0.1997	120	1.3974	0.0517	1.3974	1.1821
No log	0.2030	122	1.3179	0.0772	1.3179	1.1480
No log	0.2063	124	1.2758	0.0669	1.2758	1.1295
No log	0.2097	126	1.2294	0.0795	1.2294	1.1088
No log	0.2130	128	1.2062	0.0787	1.2062	1.0983
No log	0.2163	130	1.1317	0.0770	1.1317	1.0638
No log	0.2196	132	1.0395	0.0615	1.0395	1.0196
No log	0.2230	134	1.0116	0.0652	1.0116	1.0058
No log	0.2263	136	0.9991	0.0723	0.9991	0.9996
No log	0.2296	138	0.9830	0.0747	0.9830	0.9915
No log	0.2329	140	0.9683	0.0816	0.9683	0.9840
No log	0.2363	142	0.9370	0.0816	0.9370	0.9680
No log	0.2396	144	0.9008	0.0828	0.9008	0.9491
No log	0.2429	146	0.8708	0.0652	0.8708	0.9332
No log	0.2463	148	0.8724	0.0828	0.8724	0.9340
No log	0.2496	150	0.8698	0.0828	0.8698	0.9326
No log	0.2529	152	0.8619	0.0828	0.8619	0.9284
No log	0.2562	154	0.8605	0.0828	0.8605	0.9276
No log	0.2596	156	0.8314	0.0828	0.8314	0.9118
No log	0.2629	158	0.8554	0.0677	0.8554	0.9249
No log	0.2662	160	0.9446	0.0590	0.9446	0.9719
No log	0.2696	162	0.9124	0.0640	0.9124	0.9552
No log	0.2729	164	0.8139	0.0640	0.8139	0.9022
No log	0.2762	166	0.7758	0.0578	0.7758	0.8808
No log	0.2795	168	0.7663	0.0677	0.7663	0.8754
No log	0.2829	170	0.7804	0.0828	0.7804	0.8834
No log	0.2862	172	0.8054	0.0851	0.8054	0.8975
No log	0.2895	174	0.7848	0.0782	0.7848	0.8859
No log	0.2928	176	0.7860	0.0640	0.7860	0.8865
No log	0.2962	178	0.7941	0.0640	0.7941	0.8911
No log	0.2995	180	0.7737	0.0640	0.7737	0.8796
No log	0.3028	182	0.7728	0.0713	0.7728	0.8791
No log	0.3062	184	0.7844	0.0770	0.7844	0.8856
No log	0.3095	186	0.7860	0.0770	0.7860	0.8866
No log	0.3128	188	0.7720	0.0723	0.7720	0.8786
No log	0.3161	190	0.7596	0.0713	0.7596	0.8716
No log	0.3195	192	0.7650	0.0726	0.7650	0.8746
No log	0.3228	194	0.7768	0.0782	0.7768	0.8814
No log	0.3261	196	0.7766	0.0828	0.7766	0.8813
No log	0.3295	198	0.7596	0.0782	0.7596	0.8715
No log	0.3328	200	0.7549	0.0701	0.7549	0.8689
No log	0.3361	202	0.7539	0.0725	0.7539	0.8683
No log	0.3394	204	0.7516	0.0828	0.7516	0.8669
No log	0.3428	206	0.7503	0.0828	0.7503	0.8662
No log	0.3461	208	0.7499	0.0828	0.7499	0.8660
No log	0.3494	210	0.7917	0.0795	0.7917	0.8898
No log	0.3527	212	0.8426	0.0689	0.8426	0.9179
No log	0.3561	214	0.9743	0.0983	0.9743	0.9870
No log	0.3594	216	0.8853	0.0896	0.8853	0.9409
No log	0.3627	218	0.7804	0.0816	0.7804	0.8834
No log	0.3661	220	0.7289	0.0816	0.7289	0.8538
No log	0.3694	222	0.7586	0.0828	0.7586	0.8710
No log	0.3727	224	0.7808	0.0816	0.7808	0.8837
No log	0.3760	226	0.8130	0.0828	0.8130	0.9016
No log	0.3794	228	0.8336	0.0782	0.8336	0.9130
No log	0.3827	230	0.8558	0.0770	0.8558	0.9251
No log	0.3860	232	0.8814	0.0770	0.8814	0.9388
No log	0.3894	234	0.9002	0.0770	0.9002	0.9488
No log	0.3927	236	0.9138	0.0770	0.9138	0.9560
No log	0.3960	238	0.8839	0.0828	0.8839	0.9401
No log	0.3993	240	0.8515	0.0770	0.8515	0.9228
No log	0.4027	242	0.8354	0.0757	0.8354	0.9140
No log	0.4060	244	0.8214	0.0417	0.8214	0.9063
No log	0.4093	246	0.7911	0.0901	0.7911	0.8894
No log	0.4126	248	0.7647	0.1128	0.7647	0.8745
No log	0.4160	250	0.7614	0.2931	0.7614	0.8726
No log	0.4193	252	0.7736	0.3691	0.7736	0.8795
No log	0.4226	254	0.7901	0.3858	0.7901	0.8889
No log	0.4260	256	0.7494	0.4309	0.7494	0.8657
No log	0.4293	258	0.6878	0.2108	0.6878	0.8294
No log	0.4326	260	0.7223	0.1052	0.7223	0.8499
No log	0.4359	262	0.7394	0.0901	0.7394	0.8599
No log	0.4393	264	0.6866	0.1048	0.6866	0.8286
No log	0.4426	266	0.7142	0.2743	0.7142	0.8451
No log	0.4459	268	0.7505	0.2721	0.7505	0.8663
No log	0.4493	270	0.7347	0.1891	0.7347	0.8571
No log	0.4526	272	0.6828	0.1563	0.6828	0.8263
No log	0.4559	274	0.6698	0.1820	0.6698	0.8184
No log	0.4592	276	0.7015	0.3988	0.7015	0.8375
No log	0.4626	278	0.7196	0.4044	0.7196	0.8483
No log	0.4659	280	0.7272	0.3917	0.7272	0.8528
No log	0.4692	282	0.7250	0.3825	0.7250	0.8515
No log	0.4725	284	0.6943	0.3645	0.6943	0.8333
No log	0.4759	286	0.6819	0.2175	0.6819	0.8258
No log	0.4792	288	0.6869	0.1719	0.6869	0.8288
No log	0.4825	290	0.6735	0.2808	0.6735	0.8207
No log	0.4859	292	0.7369	0.4074	0.7369	0.8585
No log	0.4892	294	0.8308	0.2169	0.8308	0.9115
No log	0.4925	296	0.8549	0.0414	0.8549	0.9246
No log	0.4958	298	0.8654	-0.0097	0.8654	0.9303
No log	0.4992	300	0.8465	0.0055	0.8465	0.9201
No log	0.5025	302	0.7927	0.1870	0.7927	0.8903
No log	0.5058	304	0.7410	0.3861	0.7410	0.8608
No log	0.5092	306	0.7347	0.4170	0.7347	0.8571
No log	0.5125	308	0.7421	0.4022	0.7421	0.8615
No log	0.5158	310	0.7622	0.3959	0.7622	0.8731
No log	0.5191	312	0.7978	0.3651	0.7978	0.8932
No log	0.5225	314	0.7713	0.3893	0.7713	0.8782
No log	0.5258	316	0.7239	0.4185	0.7239	0.8508
No log	0.5291	318	0.7133	0.4385	0.7133	0.8446
No log	0.5324	320	0.7352	0.4139	0.7352	0.8574
No log	0.5358	322	0.7794	0.3945	0.7794	0.8828
No log	0.5391	324	0.7773	0.4004	0.7773	0.8816
No log	0.5424	326	0.7114	0.4476	0.7114	0.8434
No log	0.5458	328	0.6720	0.4297	0.6720	0.8197
No log	0.5491	330	0.6900	0.4320	0.6900	0.8307
No log	0.5524	332	0.7209	0.4133	0.7209	0.8491
No log	0.5557	334	0.7292	0.4110	0.7292	0.8539
No log	0.5591	336	0.7362	0.4189	0.7362	0.8580
No log	0.5624	338	0.6302	0.4816	0.6302	0.7939
No log	0.5657	340	0.5670	0.4705	0.5670	0.7530
No log	0.5691	342	0.5774	0.2553	0.5774	0.7599
No log	0.5724	344	0.5631	0.3084	0.5631	0.7504
No log	0.5757	346	0.5364	0.3783	0.5364	0.7324
No log	0.5790	348	0.5571	0.3644	0.5571	0.7464
No log	0.5824	350	0.5766	0.3444	0.5766	0.7593
No log	0.5857	352	0.5799	0.4340	0.5799	0.7615
No log	0.5890	354	0.6736	0.3908	0.6736	0.8208
No log	0.5923	356	0.7756	0.2196	0.7756	0.8807
No log	0.5957	358	0.8677	-0.0089	0.8677	0.9315
No log	0.5990	360	0.8669	-0.0082	0.8669	0.9311
No log	0.6023	362	0.7658	0.2599	0.7658	0.8751
No log	0.6057	364	0.6323	0.4686	0.6323	0.7952
No log	0.6090	366	0.5600	0.4166	0.5600	0.7483
No log	0.6123	368	0.6029	0.1888	0.6029	0.7765
No log	0.6156	370	0.6961	0.1833	0.6961	0.8344
No log	0.6190	372	0.7129	0.1834	0.7129	0.8444
No log	0.6223	374	0.6718	0.1634	0.6718	0.8197
No log	0.6256	376	0.5768	0.2216	0.5768	0.7595
No log	0.6290	378	0.5505	0.4257	0.5505	0.7419
No log	0.6323	380	0.5727	0.4812	0.5727	0.7568
No log	0.6356	382	0.6834	0.4825	0.6834	0.8267
No log	0.6389	384	0.8113	0.4225	0.8113	0.9007
No log	0.6423	386	0.8455	0.3076	0.8455	0.9195
No log	0.6456	388	0.8310	0.2673	0.8310	0.9116
No log	0.6489	390	0.8035	0.2079	0.8035	0.8964
No log	0.6522	392	0.7785	0.1952	0.7785	0.8823
No log	0.6556	394	0.7933	0.2193	0.7933	0.8907
No log	0.6589	396	0.7851	0.2847	0.7851	0.8861
No log	0.6622	398	0.7657	0.3726	0.7657	0.8751
No log	0.6656	400	0.5933	0.5062	0.5933	0.7702
No log	0.6689	402	0.5215	0.5138	0.5215	0.7221
No log	0.6722	404	0.5235	0.5014	0.5235	0.7235
No log	0.6755	406	0.5265	0.5092	0.5265	0.7256
No log	0.6789	408	0.5339	0.4927	0.5339	0.7307
No log	0.6822	410	0.5518	0.4635	0.5518	0.7428
No log	0.6855	412	0.5494	0.4619	0.5494	0.7412
No log	0.6889	414	0.5519	0.4523	0.5519	0.7429
No log	0.6922	416	0.5631	0.4490	0.5631	0.7504
No log	0.6955	418	0.5809	0.4731	0.5809	0.7621
No log	0.6988	420	0.6224	0.4709	0.6224	0.7889
No log	0.7022	422	0.7550	0.4454	0.7550	0.8689
No log	0.7055	424	0.8635	0.3964	0.8635	0.9293
No log	0.7088	426	0.9211	0.3401	0.9211	0.9597
No log	0.7121	428	0.9378	0.3229	0.9378	0.9684
No log	0.7155	430	0.8709	0.3652	0.8709	0.9332
No log	0.7188	432	0.8400	0.3901	0.8400	0.9165
No log	0.7221	434	0.7873	0.4384	0.7873	0.8873
No log	0.7255	436	0.6525	0.4822	0.6525	0.8078
No log	0.7288	438	0.5789	0.4763	0.5789	0.7609
No log	0.7321	440	0.5624	0.4725	0.5624	0.7499
No log	0.7354	442	0.5791	0.5106	0.5791	0.7610
No log	0.7388	444	0.5938	0.5253	0.5938	0.7706
No log	0.7421	446	0.6257	0.5225	0.6257	0.7910
No log	0.7454	448	0.6742	0.4957	0.6742	0.8211
No log	0.7488	450	0.6355	0.5129	0.6355	0.7972
No log	0.7521	452	0.5460	0.5198	0.5460	0.7389
No log	0.7554	454	0.5043	0.4489	0.5043	0.7101
No log	0.7587	456	0.5230	0.3880	0.5230	0.7232
No log	0.7621	458	0.5538	0.3405	0.5538	0.7442
No log	0.7654	460	0.5081	0.4365	0.5081	0.7128
No log	0.7687	462	0.5052	0.4907	0.5052	0.7108
No log	0.7720	464	0.5198	0.5058	0.5198	0.7209
No log	0.7754	466	0.5596	0.5410	0.5596	0.7481
No log	0.7787	468	0.5808	0.5318	0.5808	0.7621
No log	0.7820	470	0.5757	0.5284	0.5757	0.7588
No log	0.7854	472	0.5238	0.4699	0.5238	0.7237
No log	0.7887	474	0.5552	0.2828	0.5552	0.7451
No log	0.7920	476	0.6090	0.2310	0.6090	0.7804
No log	0.7953	478	0.6579	0.2154	0.6579	0.8111
No log	0.7987	480	0.6736	0.2219	0.6736	0.8207
No log	0.8020	482	0.6044	0.2244	0.6044	0.7774
No log	0.8053	484	0.5271	0.3324	0.5271	0.7260
No log	0.8087	486	0.5033	0.4270	0.5033	0.7094
No log	0.8120	488	0.5008	0.4982	0.5008	0.7076
No log	0.8153	490	0.4897	0.4886	0.4897	0.6998
No log	0.8186	492	0.4854	0.5087	0.4854	0.6967
No log	0.8220	494	0.4825	0.4877	0.4825	0.6946
No log	0.8253	496	0.4791	0.5025	0.4791	0.6922
No log	0.8286	498	0.4818	0.5307	0.4818	0.6941
1.4762	0.8319	500	0.4969	0.5274	0.4969	0.7049
1.4762	0.8353	502	0.5251	0.5325	0.5251	0.7246
1.4762	0.8386	504	0.5399	0.5379	0.5399	0.7348
1.4762	0.8419	506	0.5415	0.5198	0.5415	0.7359
1.4762	0.8453	508	0.5666	0.5352	0.5666	0.7527
1.4762	0.8486	510	0.6280	0.5207	0.6280	0.7924
1.4762	0.8519	512	0.6585	0.5223	0.6585	0.8115
1.4762	0.8552	514	0.6323	0.5240	0.6323	0.7952
1.4762	0.8586	516	0.5825	0.5315	0.5825	0.7632
1.4762	0.8619	518	0.5823	0.5421	0.5823	0.7631
1.4762	0.8652	520	0.7230	0.5018	0.7230	0.8503
1.4762	0.8686	522	0.9246	0.3349	0.9246	0.9616
1.4762	0.8719	524	1.0242	0.2411	1.0242	1.0120
1.4762	0.8752	526	1.0632	0.2996	1.0632	1.0311
1.4762	0.8785	528	1.0421	0.3192	1.0421	1.0209

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1