ASAP_FineTuningBERT_Aug_k30_task1_organization_fold0

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.4521
• Qwk: 0.5214
• Mse: 0.4521
• Rmse: 0.6724

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0043	2	9.7376	0.0	9.7376	3.1205
No log	0.0087	4	8.2231	0.0157	8.2231	2.8676
No log	0.0130	6	7.2222	0.0051	7.2222	2.6874
No log	0.0174	8	6.4567	0.0018	6.4567	2.5410
No log	0.0217	10	5.6148	0.0	5.6148	2.3696
No log	0.0261	12	4.7513	0.0	4.7513	2.1797
No log	0.0304	14	3.9229	0.0511	3.9229	1.9806
No log	0.0348	16	3.1139	0.0150	3.1139	1.7646
No log	0.0391	18	2.4532	0.0115	2.4532	1.5663
No log	0.0435	20	1.8906	0.0077	1.8906	1.3750
No log	0.0478	22	1.4962	0.0293	1.4962	1.2232
No log	0.0522	24	1.1766	0.0773	1.1766	1.0847
No log	0.0565	26	0.9416	0.0646	0.9416	0.9703
No log	0.0609	28	0.8133	0.0316	0.8133	0.9019
No log	0.0652	30	0.7824	0.0316	0.7824	0.8845
No log	0.0696	32	0.7872	0.0212	0.7872	0.8872
No log	0.0739	34	0.7451	0.0316	0.7451	0.8632
No log	0.0783	36	0.8080	0.0316	0.8080	0.8989
No log	0.0826	38	0.7830	0.0918	0.7830	0.8849
No log	0.0870	40	0.8072	0.0225	0.8072	0.8985
No log	0.0913	42	0.8840	0.0106	0.8840	0.9402
No log	0.0957	44	0.9283	0.0106	0.9283	0.9635
No log	0.1	46	0.8168	0.0106	0.8168	0.9038
No log	0.1043	48	0.8215	0.0212	0.8215	0.9064
No log	0.1087	50	0.8939	0.0316	0.8939	0.9455
No log	0.1130	52	0.8481	0.0212	0.8481	0.9209
No log	0.1174	54	0.8167	0.0106	0.8167	0.9037
No log	0.1217	56	0.8216	0.0106	0.8216	0.9064
No log	0.1261	58	0.8085	0.0106	0.8085	0.8992
No log	0.1304	60	0.8038	0.0106	0.8038	0.8966
No log	0.1348	62	0.7917	0.0106	0.7917	0.8898
No log	0.1391	64	0.7933	0.0106	0.7933	0.8907
No log	0.1435	66	0.7957	0.0106	0.7957	0.8920
No log	0.1478	68	0.7938	0.0106	0.7938	0.8910
No log	0.1522	70	0.8025	0.0	0.8025	0.8958
No log	0.1565	72	0.8696	0.0	0.8696	0.9325
No log	0.1609	74	0.9399	0.0	0.9399	0.9695
No log	0.1652	76	0.8898	0.0106	0.8898	0.9433
No log	0.1696	78	0.8434	0.0106	0.8434	0.9184
No log	0.1739	80	0.8185	0.0106	0.8185	0.9047
No log	0.1783	82	0.7686	0.0106	0.7686	0.8767
No log	0.1826	84	0.7665	0.0106	0.7665	0.8755
No log	0.1870	86	0.7691	0.0316	0.7691	0.8770
No log	0.1913	88	0.8648	0.0316	0.8648	0.9300
No log	0.1957	90	0.7887	0.0316	0.7887	0.8881
No log	0.2	92	0.7468	0.0212	0.7468	0.8642
No log	0.2043	94	0.7636	0.0106	0.7636	0.8738
No log	0.2087	96	0.7687	0.0106	0.7687	0.8768
No log	0.2130	98	0.7766	0.0106	0.7766	0.8812
No log	0.2174	100	0.8050	0.0106	0.8050	0.8972
No log	0.2217	102	0.8412	0.0316	0.8412	0.9172
No log	0.2261	104	0.8464	0.0316	0.8464	0.9200
No log	0.2304	106	0.7913	0.0316	0.7913	0.8895
No log	0.2348	108	0.7621	0.0106	0.7621	0.8730
No log	0.2391	110	0.7807	0.0106	0.7807	0.8836
No log	0.2435	112	0.7985	0.0106	0.7985	0.8936
No log	0.2478	114	0.7795	0.0106	0.7795	0.8829
No log	0.2522	116	0.7512	0.0212	0.7512	0.8667
No log	0.2565	118	0.7328	0.0316	0.7328	0.8560
No log	0.2609	120	0.8243	0.0316	0.8243	0.9079
No log	0.2652	122	0.9012	0.0484	0.9012	0.9493
No log	0.2696	124	0.8059	0.0316	0.8059	0.8977
No log	0.2739	126	0.7405	0.0316	0.7405	0.8605
No log	0.2783	128	0.7408	0.0106	0.7408	0.8607
No log	0.2826	130	0.7662	0.0106	0.7662	0.8753
No log	0.2870	132	0.7785	0.0106	0.7785	0.8823
No log	0.2913	134	0.7561	0.0106	0.7561	0.8695
No log	0.2957	136	0.7496	0.0328	0.7496	0.8658
No log	0.3	138	0.7440	0.0316	0.7440	0.8625
No log	0.3043	140	0.7671	0.0316	0.7671	0.8758
No log	0.3087	142	0.7866	0.0316	0.7866	0.8869
No log	0.3130	144	0.7314	0.0316	0.7314	0.8552
No log	0.3174	146	0.7260	0.2015	0.7260	0.8520
No log	0.3217	148	0.7337	0.3231	0.7337	0.8566
No log	0.3261	150	0.7227	0.0933	0.7227	0.8501
No log	0.3304	152	0.7684	0.0	0.7684	0.8766
No log	0.3348	154	0.7608	0.0	0.7608	0.8722
No log	0.3391	156	0.7193	0.1679	0.7193	0.8481
No log	0.3435	158	0.7731	0.2609	0.7731	0.8793
No log	0.3478	160	0.7710	0.2735	0.7710	0.8781
No log	0.3522	162	0.7063	0.3678	0.7063	0.8404
No log	0.3565	164	0.7033	0.0631	0.7033	0.8387
No log	0.3609	166	0.7511	0.0371	0.7511	0.8667
No log	0.3652	168	0.7130	0.1499	0.7130	0.8444
No log	0.3696	170	0.6986	0.2844	0.6986	0.8358
No log	0.3739	172	0.7514	0.2885	0.7514	0.8668
No log	0.3783	174	0.7737	0.2817	0.7737	0.8796
No log	0.3826	176	0.7281	0.4035	0.7281	0.8533
No log	0.3870	178	0.6763	0.2386	0.6763	0.8223
No log	0.3913	180	0.6774	0.0777	0.6774	0.8231
No log	0.3957	182	0.6841	0.0768	0.6841	0.8271
No log	0.4	184	0.6838	0.1593	0.6838	0.8269
No log	0.4043	186	0.6848	0.1732	0.6848	0.8275
No log	0.4087	188	0.6917	0.2934	0.6917	0.8317
No log	0.4130	190	0.6859	0.2976	0.6859	0.8282
No log	0.4174	192	0.6571	0.2780	0.6571	0.8106
No log	0.4217	194	0.6494	0.2814	0.6494	0.8058
No log	0.4261	196	0.6352	0.2858	0.6352	0.7970
No log	0.4304	198	0.6375	0.2400	0.6375	0.7984
No log	0.4348	200	0.6283	0.2556	0.6283	0.7927
No log	0.4391	202	0.6211	0.2538	0.6211	0.7881
No log	0.4435	204	0.6536	0.1922	0.6536	0.8085
No log	0.4478	206	0.6230	0.2833	0.6230	0.7893
No log	0.4522	208	0.6671	0.3537	0.6671	0.8168
No log	0.4565	210	0.6533	0.3820	0.6533	0.8083
No log	0.4609	212	0.6097	0.2949	0.6097	0.7808
No log	0.4652	214	0.6776	0.0915	0.6776	0.8232
No log	0.4696	216	0.6834	0.0742	0.6834	0.8267
No log	0.4739	218	0.6255	0.1744	0.6255	0.7909
No log	0.4783	220	0.6353	0.3711	0.6353	0.7970
No log	0.4826	222	0.6855	0.3991	0.6855	0.8279
No log	0.4870	224	0.6439	0.3738	0.6439	0.8024
No log	0.4913	226	0.6042	0.3345	0.6042	0.7773
No log	0.4957	228	0.6008	0.2651	0.6008	0.7751
No log	0.5	230	0.6033	0.2480	0.6033	0.7767
No log	0.5043	232	0.5673	0.3007	0.5673	0.7532
No log	0.5087	234	0.5501	0.3548	0.5501	0.7417
No log	0.5130	236	0.5347	0.3222	0.5347	0.7312
No log	0.5174	238	0.5862	0.2982	0.5862	0.7657
No log	0.5217	240	0.5472	0.3541	0.5472	0.7397
No log	0.5261	242	0.5407	0.3289	0.5407	0.7353
No log	0.5304	244	0.5226	0.3774	0.5226	0.7229
No log	0.5348	246	0.5984	0.4416	0.5984	0.7735
No log	0.5391	248	0.5992	0.4080	0.5992	0.7741
No log	0.5435	250	0.5797	0.3034	0.5797	0.7614
No log	0.5478	252	0.6400	0.1678	0.6400	0.8000
No log	0.5522	254	0.6492	0.1521	0.6492	0.8057
No log	0.5565	256	0.6116	0.2381	0.6116	0.7821
No log	0.5609	258	0.6107	0.3025	0.6107	0.7815
No log	0.5652	260	0.5974	0.3512	0.5974	0.7729
No log	0.5696	262	0.5840	0.3901	0.5840	0.7642
No log	0.5739	264	0.5744	0.4389	0.5744	0.7579
No log	0.5783	266	0.5593	0.4374	0.5593	0.7479
No log	0.5826	268	0.5418	0.4073	0.5418	0.7361
No log	0.5870	270	0.5227	0.3628	0.5227	0.7230
No log	0.5913	272	0.5170	0.3736	0.5170	0.7190
No log	0.5957	274	0.5366	0.4429	0.5366	0.7326
No log	0.6	276	0.6117	0.4803	0.6117	0.7821
No log	0.6043	278	0.5852	0.4777	0.5852	0.7650
No log	0.6087	280	0.5203	0.4186	0.5203	0.7213
No log	0.6130	282	0.5355	0.3705	0.5355	0.7318
No log	0.6174	284	0.5844	0.4319	0.5844	0.7645
No log	0.6217	286	0.6789	0.4226	0.6789	0.8240
No log	0.6261	288	0.6965	0.4043	0.6965	0.8345
No log	0.6304	290	0.6979	0.3090	0.6979	0.8354
No log	0.6348	292	0.6956	0.1306	0.6956	0.8340
No log	0.6391	294	0.6937	0.2307	0.6937	0.8329
No log	0.6435	296	0.7274	0.3938	0.7274	0.8529
No log	0.6478	298	0.7399	0.3914	0.7399	0.8602
No log	0.6522	300	0.7004	0.3954	0.7004	0.8369
No log	0.6565	302	0.6807	0.4076	0.6807	0.8250
No log	0.6609	304	0.6861	0.4057	0.6861	0.8283
No log	0.6652	306	0.7051	0.4141	0.7051	0.8397
No log	0.6696	308	0.6065	0.4422	0.6065	0.7788
No log	0.6739	310	0.5671	0.4533	0.5671	0.7531
No log	0.6783	312	0.5367	0.4263	0.5367	0.7326
No log	0.6826	314	0.5320	0.3973	0.5320	0.7294
No log	0.6870	316	0.5601	0.4449	0.5601	0.7484
No log	0.6913	318	0.5614	0.4602	0.5614	0.7493
No log	0.6957	320	0.5261	0.4478	0.5261	0.7253
No log	0.7	322	0.5011	0.3974	0.5011	0.7079
No log	0.7043	324	0.4962	0.4233	0.4962	0.7044
No log	0.7087	326	0.5520	0.4950	0.5520	0.7430
No log	0.7130	328	0.6579	0.4559	0.6579	0.8111
No log	0.7174	330	0.6141	0.4745	0.6141	0.7836
No log	0.7217	332	0.5114	0.4372	0.5114	0.7151
No log	0.7261	334	0.5014	0.3636	0.5014	0.7081
No log	0.7304	336	0.5135	0.4430	0.5135	0.7166
No log	0.7348	338	0.5716	0.4912	0.5716	0.7561
No log	0.7391	340	0.5973	0.4691	0.5973	0.7729
No log	0.7435	342	0.5154	0.4731	0.5154	0.7179
No log	0.7478	344	0.4973	0.4592	0.4973	0.7052
No log	0.7522	346	0.4926	0.4834	0.4926	0.7018
No log	0.7565	348	0.4799	0.4820	0.4799	0.6927
No log	0.7609	350	0.5116	0.4920	0.5116	0.7153
No log	0.7652	352	0.4946	0.4944	0.4946	0.7033
No log	0.7696	354	0.4599	0.4632	0.4599	0.6782
No log	0.7739	356	0.4481	0.4654	0.4481	0.6694
No log	0.7783	358	0.4434	0.4761	0.4434	0.6659
No log	0.7826	360	0.4435	0.4819	0.4435	0.6659
No log	0.7870	362	0.4450	0.4786	0.4450	0.6671
No log	0.7913	364	0.4646	0.4587	0.4646	0.6816
No log	0.7957	366	0.4546	0.4504	0.4546	0.6743
No log	0.8	368	0.4705	0.5066	0.4705	0.6859
No log	0.8043	370	0.4892	0.5283	0.4892	0.6994
No log	0.8087	372	0.4638	0.5183	0.4638	0.6810
No log	0.8130	374	0.4609	0.5255	0.4609	0.6789
No log	0.8174	376	0.4455	0.4976	0.4455	0.6675
No log	0.8217	378	0.4618	0.5188	0.4618	0.6795
No log	0.8261	380	0.5500	0.5327	0.5500	0.7416
No log	0.8304	382	0.6166	0.4929	0.6166	0.7852
No log	0.8348	384	0.5390	0.5080	0.5390	0.7342
No log	0.8391	386	0.4748	0.4950	0.4748	0.6891
No log	0.8435	388	0.4508	0.4792	0.4508	0.6714
No log	0.8478	390	0.4591	0.5105	0.4591	0.6776
No log	0.8522	392	0.4684	0.5309	0.4684	0.6844
No log	0.8565	394	0.4326	0.5115	0.4326	0.6577
No log	0.8609	396	0.4353	0.4768	0.4353	0.6597
No log	0.8652	398	0.4447	0.4687	0.4447	0.6669
No log	0.8696	400	0.4457	0.4863	0.4457	0.6676
No log	0.8739	402	0.4559	0.4827	0.4559	0.6752
No log	0.8783	404	0.4504	0.4926	0.4504	0.6711
No log	0.8826	406	0.4498	0.4497	0.4498	0.6706
No log	0.8870	408	0.4544	0.4467	0.4544	0.6741
No log	0.8913	410	0.4858	0.4144	0.4858	0.6970
No log	0.8957	412	0.4912	0.4043	0.4912	0.7008
No log	0.9	414	0.4608	0.4438	0.4608	0.6788
No log	0.9043	416	0.4753	0.5117	0.4753	0.6894
No log	0.9087	418	0.4769	0.5208	0.4769	0.6906
No log	0.9130	420	0.4655	0.5091	0.4655	0.6823
No log	0.9174	422	0.4784	0.5300	0.4784	0.6917
No log	0.9217	424	0.5397	0.5164	0.5397	0.7346
No log	0.9261	426	0.5134	0.5000	0.5134	0.7165
No log	0.9304	428	0.4806	0.4992	0.4806	0.6932
No log	0.9348	430	0.4824	0.5027	0.4824	0.6946
No log	0.9391	432	0.5018	0.4945	0.5018	0.7084
No log	0.9435	434	0.5082	0.4882	0.5082	0.7129
No log	0.9478	436	0.5398	0.4799	0.5398	0.7347
No log	0.9522	438	0.5225	0.4468	0.5225	0.7229
No log	0.9565	440	0.5172	0.3704	0.5172	0.7191
No log	0.9609	442	0.4956	0.4590	0.4956	0.7040
No log	0.9652	444	0.5131	0.5137	0.5131	0.7163
No log	0.9696	446	0.4538	0.5389	0.4538	0.6736
No log	0.9739	448	0.4386	0.5333	0.4386	0.6622
No log	0.9783	450	0.4621	0.5385	0.4621	0.6798
No log	0.9826	452	0.4845	0.5798	0.4845	0.6960
No log	0.9870	454	0.4245	0.5227	0.4245	0.6515
No log	0.9913	456	0.4191	0.5289	0.4191	0.6474
No log	0.9957	458	0.4216	0.5463	0.4216	0.6493
No log	1.0	460	0.4783	0.5853	0.4783	0.6916
No log	1.0043	462	0.6105	0.6376	0.6105	0.7814
No log	1.0087	464	0.5350	0.6522	0.5350	0.7314
No log	1.0130	466	0.4554	0.5433	0.4554	0.6748
No log	1.0174	468	0.5334	0.4784	0.5334	0.7304
No log	1.0217	470	0.4555	0.5381	0.4555	0.6749
No log	1.0261	472	0.4274	0.5664	0.4274	0.6538
No log	1.0304	474	0.4656	0.5844	0.4656	0.6823
No log	1.0348	476	0.4460	0.5591	0.4460	0.6678
No log	1.0391	478	0.4440	0.5368	0.4440	0.6663
No log	1.0435	480	0.4350	0.5475	0.4350	0.6595
No log	1.0478	482	0.4473	0.5669	0.4473	0.6688
No log	1.0522	484	0.4715	0.6083	0.4715	0.6866
No log	1.0565	486	0.4676	0.6255	0.4676	0.6838
No log	1.0609	488	0.4225	0.5678	0.4225	0.6500
No log	1.0652	490	0.4627	0.4543	0.4627	0.6802
No log	1.0696	492	0.4859	0.4052	0.4859	0.6971
No log	1.0739	494	0.4252	0.4804	0.4252	0.6521
No log	1.0783	496	0.5164	0.5807	0.5164	0.7186
No log	1.0826	498	0.6693	0.5732	0.6693	0.8181
0.534	1.0870	500	0.6468	0.5614	0.6468	0.8042
0.534	1.0913	502	0.5338	0.5027	0.5338	0.7306
0.534	1.0957	504	0.4912	0.4057	0.4912	0.7009
0.534	1.1	506	0.4848	0.4214	0.4848	0.6963
0.534	1.1043	508	0.5368	0.5663	0.5368	0.7326
0.534	1.1087	510	0.6050	0.5698	0.6050	0.7778
0.534	1.1130	512	0.4991	0.5748	0.4991	0.7065
0.534	1.1174	514	0.4562	0.4147	0.4562	0.6754
0.534	1.1217	516	0.5353	0.3535	0.5353	0.7316
0.534	1.1261	518	0.4964	0.3756	0.4964	0.7046
0.534	1.1304	520	0.4479	0.5072	0.4479	0.6693
0.534	1.1348	522	0.4521	0.5214	0.4521	0.6724

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1