ASAP_FineTuningBERT_Aug_k60_task1_organization_fold0

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5756
• Qwk: 0.3589
• Mse: 0.5756
• Rmse: 0.7587

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0023	2	9.7757	0.0	9.7757	3.1266
No log	0.0045	4	8.3391	0.0054	8.3392	2.8878
No log	0.0068	6	7.3008	0.0053	7.3008	2.7020
No log	0.0090	8	6.5296	0.0018	6.5296	2.5553
No log	0.0113	10	5.7226	0.0	5.7226	2.3922
No log	0.0136	12	4.8806	0.0	4.8806	2.2092
No log	0.0158	14	4.0799	0.0196	4.0799	2.0199
No log	0.0181	16	3.3167	0.0150	3.3167	1.8212
No log	0.0203	18	2.6254	0.0115	2.6254	1.6203
No log	0.0226	20	2.0529	0.0077	2.0529	1.4328
No log	0.0249	22	1.5903	0.0077	1.5903	1.2611
No log	0.0271	24	1.2273	0.0870	1.2273	1.1078
No log	0.0294	26	1.0110	0.0548	1.0110	1.0055
No log	0.0316	28	0.8388	0.0382	0.8388	0.9159
No log	0.0339	30	0.8194	0.0316	0.8194	0.9052
No log	0.0362	32	0.8358	0.0212	0.8358	0.9142
No log	0.0384	34	0.8075	0.0212	0.8075	0.8986
No log	0.0407	36	0.8145	0.0212	0.8145	0.9025
No log	0.0429	38	0.8133	0.0212	0.8133	0.9018
No log	0.0452	40	0.8628	0.0212	0.8628	0.9288
No log	0.0475	42	0.8056	0.0212	0.8056	0.8976
No log	0.0497	44	0.7729	0.0212	0.7729	0.8791
No log	0.0520	46	0.8103	0.0212	0.8103	0.9001
No log	0.0542	48	0.9480	0.0316	0.9480	0.9737
No log	0.0565	50	0.8500	0.0212	0.8500	0.9219
No log	0.0588	52	0.8435	0.0212	0.8435	0.9184
No log	0.0610	54	0.8609	0.0212	0.8609	0.9278
No log	0.0633	56	0.8365	0.0212	0.8365	0.9146
No log	0.0655	58	0.8303	0.0106	0.8303	0.9112
No log	0.0678	60	0.8224	0.0106	0.8224	0.9069
No log	0.0701	62	0.8042	0.0106	0.8042	0.8968
No log	0.0723	64	0.7771	0.0106	0.7771	0.8815
No log	0.0746	66	0.7872	0.0106	0.7872	0.8873
No log	0.0768	68	0.7997	0.0	0.7997	0.8943
No log	0.0791	70	0.8050	0.0	0.8050	0.8972
No log	0.0814	72	0.8877	0.0106	0.8877	0.9422
No log	0.0836	74	0.8397	0.0106	0.8397	0.9163
No log	0.0859	76	0.8188	0.0	0.8188	0.9049
No log	0.0881	78	0.8844	0.0	0.8844	0.9404
No log	0.0904	80	0.8936	0.0	0.8936	0.9453
No log	0.0927	82	0.8494	0.0	0.8494	0.9216
No log	0.0949	84	0.8236	0.0106	0.8236	0.9075
No log	0.0972	86	0.8276	0.0106	0.8276	0.9097
No log	0.0994	88	0.8304	0.0106	0.8304	0.9113
No log	0.1017	90	0.8641	0.0212	0.8641	0.9296
No log	0.1040	92	0.8846	0.0316	0.8846	0.9405
No log	0.1062	94	0.8015	0.0316	0.8015	0.8953
No log	0.1085	96	0.7375	0.0418	0.7375	0.8588
No log	0.1107	98	0.7243	0.0518	0.7243	0.8511
No log	0.1130	100	0.7647	0.0581	0.7647	0.8745
No log	0.1153	102	0.7669	0.0581	0.7669	0.8757
No log	0.1175	104	0.7310	0.0518	0.7310	0.8550
No log	0.1198	106	0.7784	0.0315	0.7784	0.8823
No log	0.1220	108	0.8725	0.0212	0.8725	0.9341
No log	0.1243	110	0.9824	0.0212	0.9824	0.9912
No log	0.1266	112	0.9050	0.0212	0.9050	0.9513
No log	0.1288	114	0.8121	0.0212	0.8121	0.9011
No log	0.1311	116	0.7942	0.0212	0.7942	0.8912
No log	0.1333	118	0.7891	0.0212	0.7891	0.8883
No log	0.1356	120	0.7927	0.0212	0.7927	0.8904
No log	0.1379	122	0.8378	0.0212	0.8378	0.9153
No log	0.1401	124	0.9585	0.0212	0.9585	0.9790
No log	0.1424	126	0.9320	0.0212	0.9320	0.9654
No log	0.1446	128	0.8168	0.0212	0.8168	0.9038
No log	0.1469	130	0.7699	0.0212	0.7699	0.8775
No log	0.1492	132	0.7611	0.0212	0.7611	0.8724
No log	0.1514	134	0.7611	0.0212	0.7611	0.8724
No log	0.1537	136	0.7697	0.0212	0.7697	0.8773
No log	0.1559	138	0.8179	0.0212	0.8179	0.9044
No log	0.1582	140	0.8478	0.0212	0.8478	0.9208
No log	0.1605	142	0.8099	0.0212	0.8099	0.8999
No log	0.1627	144	0.7548	0.0212	0.7548	0.8688
No log	0.1650	146	0.7333	0.0212	0.7333	0.8564
No log	0.1672	148	0.7339	0.0780	0.7339	0.8567
No log	0.1695	150	0.7255	0.0220	0.7255	0.8518
No log	0.1718	152	0.7446	0.0212	0.7446	0.8629
No log	0.1740	154	0.8591	0.0212	0.8591	0.9269
No log	0.1763	156	0.8623	0.0212	0.8623	0.9286
No log	0.1785	158	0.7841	0.0212	0.7841	0.8855
No log	0.1808	160	0.7433	0.0258	0.7433	0.8622
No log	0.1831	162	0.7488	0.0267	0.7488	0.8653
No log	0.1853	164	0.7580	0.0212	0.7580	0.8706
No log	0.1876	166	0.7921	0.0212	0.7921	0.8900
No log	0.1898	168	0.8718	0.0212	0.8718	0.9337
No log	0.1921	170	0.8899	0.0212	0.8899	0.9433
No log	0.1944	172	0.8429	0.0212	0.8429	0.9181
No log	0.1966	174	0.7848	0.0212	0.7848	0.8859
No log	0.1989	176	0.7676	0.0212	0.7676	0.8761
No log	0.2011	178	0.7779	0.0743	0.7779	0.8820
No log	0.2034	180	0.7779	0.1063	0.7779	0.8820
No log	0.2056	182	0.7641	0.0267	0.7641	0.8741
No log	0.2079	184	0.7648	0.0212	0.7648	0.8745
No log	0.2102	186	0.8237	0.0212	0.8237	0.9076
No log	0.2124	188	0.9160	0.0212	0.9160	0.9571
No log	0.2147	190	0.9674	0.0212	0.9674	0.9836
No log	0.2169	192	0.9310	0.0212	0.9310	0.9649
No log	0.2192	194	0.8505	0.0212	0.8505	0.9222
No log	0.2215	196	0.7814	0.0212	0.7814	0.8839
No log	0.2237	198	0.7629	0.0212	0.7629	0.8734
No log	0.2260	200	0.7640	0.0212	0.7640	0.8741
No log	0.2282	202	0.7623	0.0212	0.7623	0.8731
No log	0.2305	204	0.7617	0.0212	0.7617	0.8727
No log	0.2328	206	0.7941	0.0212	0.7941	0.8911
No log	0.2350	208	0.8298	0.0212	0.8298	0.9109
No log	0.2373	210	0.8132	0.0212	0.8132	0.9018
No log	0.2395	212	0.7739	0.0212	0.7739	0.8797
No log	0.2418	214	0.7571	0.0212	0.7571	0.8701
No log	0.2441	216	0.7652	0.0919	0.7652	0.8748
No log	0.2463	218	0.7742	0.1092	0.7742	0.8799
No log	0.2486	220	0.7692	0.0596	0.7692	0.8771
No log	0.2508	222	0.7537	0.0267	0.7537	0.8681
No log	0.2531	224	0.7621	0.0212	0.7621	0.8730
No log	0.2554	226	0.7849	0.0212	0.7849	0.8859
No log	0.2576	228	0.7659	0.0212	0.7659	0.8752
No log	0.2599	230	0.7556	0.0313	0.7556	0.8692
No log	0.2621	232	0.7646	0.0712	0.7646	0.8744
No log	0.2644	234	0.7961	0.0212	0.7961	0.8923
No log	0.2667	236	0.7986	0.0212	0.7986	0.8936
No log	0.2689	238	0.7732	0.0358	0.7732	0.8793
No log	0.2712	240	0.7682	0.0439	0.7682	0.8765
No log	0.2734	242	0.7573	0.0631	0.7573	0.8702
No log	0.2757	244	0.7436	0.0985	0.7436	0.8623
No log	0.2780	246	0.7330	0.1808	0.7330	0.8562
No log	0.2802	248	0.7230	0.2115	0.7230	0.8503
No log	0.2825	250	0.7147	0.2372	0.7147	0.8454
No log	0.2847	252	0.7064	0.2720	0.7064	0.8405
No log	0.2870	254	0.6878	0.1925	0.6878	0.8294
No log	0.2893	256	0.7323	0.0451	0.7323	0.8557
No log	0.2915	258	0.7279	0.0688	0.7279	0.8532
No log	0.2938	260	0.6760	0.1642	0.6760	0.8222
No log	0.2960	262	0.6774	0.3359	0.6774	0.8231
No log	0.2983	264	0.7034	0.3711	0.7034	0.8387
No log	0.3006	266	0.6999	0.1249	0.6999	0.8366
No log	0.3028	268	0.7761	0.0212	0.7761	0.8810
No log	0.3051	270	0.7078	0.1142	0.7078	0.8413
No log	0.3073	272	0.7208	0.3434	0.7208	0.8490
No log	0.3096	274	0.8242	0.2710	0.8242	0.9079
No log	0.3119	276	0.7768	0.0818	0.7768	0.8814
No log	0.3141	278	0.8153	0.0212	0.8153	0.9029
No log	0.3164	280	0.7888	0.0310	0.7888	0.8881
No log	0.3186	282	0.7013	0.1800	0.7013	0.8374
No log	0.3209	284	0.6856	0.3083	0.6856	0.8280
No log	0.3232	286	0.6747	0.2012	0.6747	0.8214
No log	0.3254	288	0.7107	0.0613	0.7107	0.8430
No log	0.3277	290	0.6883	0.1331	0.6883	0.8296
No log	0.3299	292	0.6815	0.1495	0.6815	0.8255
No log	0.3322	294	0.6997	0.2721	0.6997	0.8365
No log	0.3345	296	0.7171	0.1383	0.7171	0.8468
No log	0.3367	298	0.7285	0.0209	0.7285	0.8535
No log	0.3390	300	0.7477	0.0008	0.7477	0.8647
No log	0.3412	302	0.7204	0.0072	0.7204	0.8488
No log	0.3435	304	0.6887	0.2617	0.6887	0.8299
No log	0.3458	306	0.7344	0.3644	0.7344	0.8570
No log	0.3480	308	0.7020	0.3615	0.7020	0.8378
No log	0.3503	310	0.6573	0.2715	0.6573	0.8108
No log	0.3525	312	0.6658	0.2270	0.6658	0.8159
No log	0.3548	314	0.6967	0.3075	0.6967	0.8347
No log	0.3571	316	0.7528	0.3230	0.7528	0.8676
No log	0.3593	318	0.7209	0.3354	0.7209	0.8491
No log	0.3616	320	0.6883	0.1768	0.6883	0.8297
No log	0.3638	322	0.7256	0.0517	0.7256	0.8518
No log	0.3661	324	0.7057	0.1241	0.7057	0.8401
No log	0.3684	326	0.6972	0.2058	0.6972	0.8350
No log	0.3706	328	0.6871	0.2664	0.6871	0.8289
No log	0.3729	330	0.6657	0.2318	0.6657	0.8159
No log	0.3751	332	0.6536	0.2545	0.6536	0.8085
No log	0.3774	334	0.6917	0.3525	0.6917	0.8317
No log	0.3797	336	0.7312	0.3917	0.7312	0.8551
No log	0.3819	338	0.6641	0.3156	0.6641	0.8149
No log	0.3842	340	0.6935	0.1321	0.6935	0.8327
No log	0.3864	342	0.7110	0.0982	0.7110	0.8432
No log	0.3887	344	0.6844	0.1718	0.6844	0.8273
No log	0.3910	346	0.7021	0.2983	0.7021	0.8379
No log	0.3932	348	0.7306	0.3798	0.7306	0.8547
No log	0.3955	350	0.7010	0.3146	0.7010	0.8373
No log	0.3977	352	0.6822	0.1738	0.6822	0.8259
No log	0.4	354	0.6786	0.1454	0.6786	0.8238
No log	0.4023	356	0.6593	0.1790	0.6593	0.8119
No log	0.4045	358	0.6443	0.2795	0.6443	0.8027
No log	0.4068	360	0.6542	0.3300	0.6542	0.8088
No log	0.4090	362	0.6299	0.3252	0.6299	0.7936
No log	0.4113	364	0.6298	0.3283	0.6298	0.7936
No log	0.4136	366	0.6288	0.2562	0.6288	0.7930
No log	0.4158	368	0.6283	0.3238	0.6283	0.7926
No log	0.4181	370	0.6501	0.3467	0.6501	0.8063
No log	0.4203	372	0.6513	0.3789	0.6513	0.8070
No log	0.4226	374	0.6193	0.3530	0.6193	0.7870
No log	0.4249	376	0.5979	0.3295	0.5979	0.7732
No log	0.4271	378	0.6188	0.3833	0.6188	0.7866
No log	0.4294	380	0.7527	0.3598	0.7527	0.8676
No log	0.4316	382	0.7742	0.3658	0.7742	0.8799
No log	0.4339	384	0.6139	0.4022	0.6139	0.7835
No log	0.4362	386	0.5927	0.3957	0.5927	0.7699
No log	0.4384	388	0.6513	0.4095	0.6513	0.8070
No log	0.4407	390	0.6669	0.4148	0.6669	0.8166
No log	0.4429	392	0.6376	0.3757	0.6376	0.7985
No log	0.4452	394	0.6263	0.2435	0.6263	0.7914
No log	0.4475	396	0.6174	0.2671	0.6174	0.7858
No log	0.4497	398	0.6384	0.3867	0.6384	0.7990
No log	0.4520	400	0.6547	0.4227	0.6547	0.8091
No log	0.4542	402	0.6168	0.3392	0.6168	0.7854
No log	0.4565	404	0.6289	0.1845	0.6289	0.7930
No log	0.4588	406	0.6549	0.1549	0.6549	0.8093
No log	0.4610	408	0.6173	0.2054	0.6173	0.7857
No log	0.4633	410	0.6213	0.3688	0.6213	0.7883
No log	0.4655	412	0.7711	0.3918	0.7711	0.8781
No log	0.4678	414	0.7810	0.3717	0.7810	0.8837
No log	0.4701	416	0.7127	0.4063	0.7127	0.8442
No log	0.4723	418	0.6929	0.4250	0.6929	0.8324
No log	0.4746	420	0.6197	0.3290	0.6197	0.7872
No log	0.4768	422	0.6268	0.2470	0.6268	0.7917
No log	0.4791	424	0.6354	0.2965	0.6354	0.7971
No log	0.4814	426	0.7066	0.3531	0.7066	0.8406
No log	0.4836	428	0.8652	0.2787	0.8652	0.9302
No log	0.4859	430	0.8766	0.2707	0.8766	0.9362
No log	0.4881	432	0.7585	0.3588	0.7585	0.8709
No log	0.4904	434	0.6568	0.3542	0.6568	0.8104
No log	0.4927	436	0.6211	0.3121	0.6211	0.7881
No log	0.4949	438	0.6205	0.3535	0.6205	0.7877
No log	0.4972	440	0.6376	0.4131	0.6376	0.7985
No log	0.4994	442	0.6326	0.4548	0.6326	0.7954
No log	0.5017	444	0.5983	0.4576	0.5983	0.7735
No log	0.5040	446	0.5637	0.2936	0.5637	0.7508
No log	0.5062	448	0.5692	0.2800	0.5692	0.7544
No log	0.5085	450	0.5718	0.3436	0.5718	0.7562
No log	0.5107	452	0.5875	0.2797	0.5875	0.7665
No log	0.5130	454	0.6164	0.1790	0.6164	0.7851
No log	0.5153	456	0.6180	0.1750	0.6180	0.7861
No log	0.5175	458	0.5988	0.3367	0.5988	0.7738
No log	0.5198	460	0.6397	0.4521	0.6397	0.7998
No log	0.5220	462	0.6542	0.4631	0.6542	0.8088
No log	0.5243	464	0.5878	0.3870	0.5878	0.7667
No log	0.5266	466	0.5709	0.3228	0.5709	0.7556
No log	0.5288	468	0.5880	0.2299	0.5880	0.7668
No log	0.5311	470	0.5928	0.2727	0.5928	0.7699
No log	0.5333	472	0.6447	0.4147	0.6447	0.8029
No log	0.5356	474	0.6857	0.4523	0.6857	0.8281
No log	0.5379	476	0.6493	0.4277	0.6493	0.8058
No log	0.5401	478	0.6355	0.4229	0.6355	0.7972
No log	0.5424	480	0.5858	0.3496	0.5858	0.7654
No log	0.5446	482	0.5659	0.2707	0.5659	0.7523
No log	0.5469	484	0.5440	0.3555	0.5440	0.7376
No log	0.5492	486	0.6520	0.4661	0.6520	0.8075
No log	0.5514	488	0.9092	0.3683	0.9092	0.9535
No log	0.5537	490	0.8338	0.3875	0.8338	0.9132
No log	0.5559	492	0.5826	0.4436	0.5826	0.7633
No log	0.5582	494	0.5421	0.2918	0.5421	0.7363
No log	0.5605	496	0.5826	0.2167	0.5826	0.7633
No log	0.5627	498	0.5790	0.2489	0.5790	0.7609
0.5323	0.5650	500	0.6075	0.3814	0.6075	0.7794
0.5323	0.5672	502	0.6683	0.4531	0.6683	0.8175
0.5323	0.5695	504	0.6646	0.4381	0.6646	0.8152
0.5323	0.5718	506	0.6240	0.3325	0.6240	0.7899
0.5323	0.5740	508	0.6114	0.3215	0.6114	0.7819
0.5323	0.5763	510	0.5979	0.3062	0.5979	0.7733
0.5323	0.5785	512	0.5849	0.3207	0.5849	0.7648
0.5323	0.5808	514	0.5756	0.3589	0.5756	0.7587

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1