ASAP_FineTuningBERT_Aug_k20_task1_organization_fold1

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.4063
• Qwk: 0.5441
• Mse: 0.4063
• Rmse: 0.6374

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0060	2	9.8538	0.0	9.8538	3.1391
No log	0.0120	4	7.5205	0.0213	7.5205	2.7424
No log	0.0181	6	6.8656	0.0018	6.8656	2.6202
No log	0.0241	8	6.0945	0.0	6.0945	2.4687
No log	0.0301	10	5.6492	0.0	5.6492	2.3768
No log	0.0361	12	4.8146	0.0	4.8146	2.1942
No log	0.0422	14	4.1150	0.0	4.1150	2.0285
No log	0.0482	16	3.3946	0.0297	3.3946	1.8424
No log	0.0542	18	2.7416	0.0118	2.7416	1.6558
No log	0.0602	20	2.1167	0.0079	2.1167	1.4549
No log	0.0663	22	1.6121	0.0	1.6121	1.2697
No log	0.0723	24	1.2816	0.1643	1.2816	1.1321
No log	0.0783	26	1.0878	0.1060	1.0878	1.0430
No log	0.0843	28	0.9893	0.0211	0.9893	0.9946
No log	0.0904	30	0.8874	0.0211	0.8874	0.9420
No log	0.0964	32	0.8744	0.0211	0.8744	0.9351
No log	0.1024	34	0.8581	0.0106	0.8581	0.9263
No log	0.1084	36	0.8897	0.0106	0.8897	0.9432
No log	0.1145	38	0.8408	0.0106	0.8408	0.9170
No log	0.1205	40	0.9843	0.1325	0.9843	0.9921
No log	0.1265	42	1.0066	0.0	1.0066	1.0033
No log	0.1325	44	0.9551	0.0	0.9551	0.9773
No log	0.1386	46	0.8306	0.0	0.8306	0.9114
No log	0.1446	48	0.7559	0.0106	0.7559	0.8694
No log	0.1506	50	0.7449	0.0106	0.7449	0.8630
No log	0.1566	52	0.7499	0.0106	0.7499	0.8660
No log	0.1627	54	0.8259	0.0106	0.8259	0.9088
No log	0.1687	56	0.8342	0.0106	0.8342	0.9134
No log	0.1747	58	0.8480	0.0106	0.8480	0.9209
No log	0.1807	60	0.8004	0.0106	0.8004	0.8947
No log	0.1867	62	0.8020	0.0106	0.8020	0.8955
No log	0.1928	64	0.7901	0.0132	0.7901	0.8889
No log	0.1988	66	0.7705	0.0106	0.7705	0.8778
No log	0.2048	68	0.7646	0.0477	0.7646	0.8744
No log	0.2108	70	0.7771	0.0106	0.7771	0.8816
No log	0.2169	72	0.8900	0.0	0.8900	0.9434
No log	0.2229	74	0.9312	0.0	0.9312	0.9650
No log	0.2289	76	0.7507	0.0211	0.7507	0.8664
No log	0.2349	78	0.8049	0.1726	0.8049	0.8972
No log	0.2410	80	0.7495	0.1392	0.7495	0.8657
No log	0.2470	82	0.6772	0.0570	0.6772	0.8229
No log	0.2530	84	0.6693	0.0803	0.6693	0.8181
No log	0.2590	86	0.6966	0.0999	0.6966	0.8346
No log	0.2651	88	0.7758	0.1809	0.7758	0.8808
No log	0.2711	90	0.6627	0.0620	0.6627	0.8140
No log	0.2771	92	0.6599	0.0941	0.6599	0.8123
No log	0.2831	94	0.6633	0.0669	0.6633	0.8144
No log	0.2892	96	0.6847	0.0604	0.6847	0.8275
No log	0.2952	98	0.8380	0.0052	0.8380	0.9154
No log	0.3012	100	0.9455	0.0	0.9455	0.9724
No log	0.3072	102	0.9850	0.0	0.9850	0.9925
No log	0.3133	104	0.9506	0.0	0.9506	0.9750
No log	0.3193	106	0.9171	-0.0027	0.9171	0.9576
No log	0.3253	108	0.8876	0.0116	0.8876	0.9421
No log	0.3313	110	0.8296	0.0025	0.8296	0.9108
No log	0.3373	112	0.7703	0.0	0.7703	0.8777
No log	0.3434	114	0.7313	0.0211	0.7313	0.8552
No log	0.3494	116	0.7281	0.0276	0.7281	0.8533
No log	0.3554	118	0.7371	0.0211	0.7371	0.8585
No log	0.3614	120	0.8136	0.2752	0.8136	0.9020
No log	0.3675	122	0.8426	0.3032	0.8426	0.9179
No log	0.3735	124	0.8149	0.0	0.8149	0.9027
No log	0.3795	126	0.8598	0.0	0.8598	0.9273
No log	0.3855	128	0.8445	0.0	0.8445	0.9189
No log	0.3916	130	0.7930	0.0	0.7930	0.8905
No log	0.3976	132	0.7897	0.0742	0.7897	0.8887
No log	0.4036	134	0.7592	0.0779	0.7592	0.8713
No log	0.4096	136	0.7340	0.0250	0.7340	0.8567
No log	0.4157	138	0.7109	0.0631	0.7109	0.8432
No log	0.4217	140	0.7010	0.3134	0.7010	0.8372
No log	0.4277	142	0.7485	0.4716	0.7485	0.8652
No log	0.4337	144	0.7055	0.3984	0.7055	0.8399
No log	0.4398	146	0.6043	0.2866	0.6043	0.7774
No log	0.4458	148	0.6090	0.1808	0.6090	0.7804
No log	0.4518	150	0.6293	0.1585	0.6293	0.7933
No log	0.4578	152	0.6791	0.1350	0.6791	0.8241
No log	0.4639	154	0.7938	0.1901	0.7938	0.8910
No log	0.4699	156	0.7204	0.2131	0.7204	0.8487
No log	0.4759	158	0.6079	0.1893	0.6079	0.7797
No log	0.4819	160	0.6052	0.2001	0.6052	0.7780
No log	0.4880	162	0.6483	0.3653	0.6483	0.8052
No log	0.4940	164	0.6604	0.3441	0.6604	0.8127
No log	0.5	166	0.6017	0.2949	0.6017	0.7757
No log	0.5060	168	0.5814	0.4476	0.5814	0.7625
No log	0.5120	170	0.5913	0.5063	0.5913	0.7689
No log	0.5181	172	0.6019	0.5193	0.6019	0.7759
No log	0.5241	174	0.5463	0.4907	0.5463	0.7391
No log	0.5301	176	0.5484	0.4974	0.5484	0.7406
No log	0.5361	178	0.5551	0.4497	0.5551	0.7451
No log	0.5422	180	0.5884	0.4432	0.5884	0.7671
No log	0.5482	182	0.7529	0.4655	0.7529	0.8677
No log	0.5542	184	0.8098	0.4488	0.8098	0.8999
No log	0.5602	186	0.7082	0.4467	0.7082	0.8416
No log	0.5663	188	0.6004	0.3464	0.6004	0.7748
No log	0.5723	190	0.5929	0.2784	0.5929	0.7700
No log	0.5783	192	0.5549	0.4062	0.5549	0.7449
No log	0.5843	194	0.5563	0.5899	0.5563	0.7458
No log	0.5904	196	0.5644	0.5750	0.5644	0.7513
No log	0.5964	198	0.5137	0.5741	0.5137	0.7167
No log	0.6024	200	0.5335	0.5233	0.5335	0.7304
No log	0.6084	202	0.5050	0.5336	0.5050	0.7106
No log	0.6145	204	0.5118	0.6005	0.5118	0.7154
No log	0.6205	206	0.6248	0.5732	0.6248	0.7905
No log	0.6265	208	0.7111	0.5476	0.7111	0.8433
No log	0.6325	210	0.7781	0.5189	0.7781	0.8821
No log	0.6386	212	0.8434	0.4931	0.8434	0.9184
No log	0.6446	214	0.8126	0.5209	0.8126	0.9014
No log	0.6506	216	0.6383	0.5970	0.6383	0.7989
No log	0.6566	218	0.5315	0.6014	0.5315	0.7290
No log	0.6627	220	0.5624	0.4525	0.5624	0.7499
No log	0.6687	222	0.6333	0.3337	0.6333	0.7958
No log	0.6747	224	0.5795	0.3624	0.5795	0.7612
No log	0.6807	226	0.5073	0.5486	0.5073	0.7122
No log	0.6867	228	0.5600	0.6066	0.5600	0.7484
No log	0.6928	230	0.6215	0.5835	0.6215	0.7883
No log	0.6988	232	0.5686	0.5877	0.5686	0.7540
No log	0.7048	234	0.6028	0.5796	0.6028	0.7764
No log	0.7108	236	0.5793	0.5983	0.5793	0.7611
No log	0.7169	238	0.5310	0.6063	0.5310	0.7287
No log	0.7229	240	0.4967	0.5858	0.4967	0.7048
No log	0.7289	242	0.4868	0.5721	0.4868	0.6977
No log	0.7349	244	0.4722	0.5557	0.4722	0.6871
No log	0.7410	246	0.4724	0.5195	0.4724	0.6873
No log	0.7470	248	0.4676	0.5665	0.4676	0.6838
No log	0.7530	250	0.4837	0.5811	0.4837	0.6955
No log	0.7590	252	0.4968	0.5984	0.4968	0.7048
No log	0.7651	254	0.4773	0.6040	0.4773	0.6909
No log	0.7711	256	0.4643	0.5940	0.4643	0.6814
No log	0.7771	258	0.4890	0.6155	0.4890	0.6993
No log	0.7831	260	0.6079	0.5785	0.6079	0.7797
No log	0.7892	262	0.6645	0.5582	0.6645	0.8152
No log	0.7952	264	0.6657	0.5514	0.6657	0.8159
No log	0.8012	266	0.6675	0.5498	0.6675	0.8170
No log	0.8072	268	0.5966	0.5786	0.5966	0.7724
No log	0.8133	270	0.5300	0.6091	0.5300	0.7280
No log	0.8193	272	0.5421	0.6164	0.5421	0.7363
No log	0.8253	274	0.6810	0.5792	0.6810	0.8252
No log	0.8313	276	0.6917	0.5810	0.6917	0.8317
No log	0.8373	278	0.5877	0.6193	0.5877	0.7666
No log	0.8434	280	0.5283	0.6098	0.5283	0.7268
No log	0.8494	282	0.5171	0.5755	0.5171	0.7191
No log	0.8554	284	0.5388	0.5552	0.5388	0.7340
No log	0.8614	286	0.5772	0.5397	0.5772	0.7598
No log	0.8675	288	0.5090	0.5516	0.5090	0.7135
No log	0.8735	290	0.4698	0.4972	0.4698	0.6854
No log	0.8795	292	0.4553	0.5218	0.4553	0.6748
No log	0.8855	294	0.4614	0.5281	0.4614	0.6793
No log	0.8916	296	0.4784	0.5153	0.4784	0.6917
No log	0.8976	298	0.4488	0.5968	0.4488	0.6700
No log	0.9036	300	0.5075	0.6270	0.5075	0.7124
No log	0.9096	302	0.4963	0.6338	0.4963	0.7045
No log	0.9157	304	0.4564	0.5870	0.4564	0.6756
No log	0.9217	306	0.5087	0.5159	0.5087	0.7132
No log	0.9277	308	0.4529	0.5780	0.4529	0.6729
No log	0.9337	310	0.5123	0.6292	0.5123	0.7158
No log	0.9398	312	0.6004	0.6074	0.6004	0.7749
No log	0.9458	314	0.5623	0.6023	0.5623	0.7499
No log	0.9518	316	0.4899	0.6086	0.4899	0.6999
No log	0.9578	318	0.4493	0.5903	0.4493	0.6703
No log	0.9639	320	0.4409	0.5967	0.4409	0.6640
No log	0.9699	322	0.4509	0.6117	0.4509	0.6715
No log	0.9759	324	0.4351	0.5719	0.4351	0.6596
No log	0.9819	326	0.4458	0.6023	0.4458	0.6677
No log	0.9880	328	0.5342	0.6022	0.5342	0.7309
No log	0.9940	330	0.5829	0.5923	0.5829	0.7635
No log	1.0	332	0.5132	0.6003	0.5132	0.7164
No log	1.0060	334	0.5212	0.6055	0.5212	0.7219
No log	1.0120	336	0.5368	0.6044	0.5368	0.7327
No log	1.0181	338	0.5627	0.5900	0.5627	0.7501
No log	1.0241	340	0.5291	0.6080	0.5291	0.7274
No log	1.0301	342	0.4764	0.5559	0.4764	0.6902
No log	1.0361	344	0.4584	0.5561	0.4584	0.6770
No log	1.0422	346	0.4822	0.5822	0.4822	0.6944
No log	1.0482	348	0.4995	0.5724	0.4995	0.7068
No log	1.0542	350	0.5213	0.5983	0.5213	0.7220
No log	1.0602	352	0.4432	0.6025	0.4432	0.6657
No log	1.0663	354	0.4266	0.6011	0.4266	0.6531
No log	1.0723	356	0.4593	0.6256	0.4593	0.6777
No log	1.0783	358	0.4282	0.6277	0.4282	0.6544
No log	1.0843	360	0.4012	0.5671	0.4012	0.6334
No log	1.0904	362	0.4494	0.5048	0.4494	0.6704
No log	1.0964	364	0.4008	0.5778	0.4008	0.6331
No log	1.1024	366	0.4551	0.6453	0.4551	0.6746
No log	1.1084	368	0.4896	0.6424	0.4896	0.6997
No log	1.1145	370	0.4146	0.5919	0.4146	0.6439
No log	1.1205	372	0.4293	0.5326	0.4293	0.6552
No log	1.1265	374	0.4293	0.5315	0.4293	0.6552
No log	1.1325	376	0.4753	0.5957	0.4753	0.6894
No log	1.1386	378	0.6103	0.5992	0.6103	0.7812
No log	1.1446	380	0.6979	0.5847	0.6979	0.8354
No log	1.1506	382	0.5574	0.6284	0.5574	0.7466
No log	1.1566	384	0.4114	0.6228	0.4114	0.6414
No log	1.1627	386	0.4050	0.6184	0.4050	0.6364
No log	1.1687	388	0.4458	0.6544	0.4458	0.6677
No log	1.1747	390	0.4770	0.6515	0.4770	0.6906
No log	1.1807	392	0.4387	0.6407	0.4387	0.6623
No log	1.1867	394	0.4974	0.5471	0.4974	0.7053
No log	1.1928	396	0.5162	0.5377	0.5162	0.7185
No log	1.1988	398	0.4317	0.6337	0.4317	0.6570
No log	1.2048	400	0.5618	0.6426	0.5618	0.7496
No log	1.2108	402	0.7052	0.6094	0.7052	0.8398
No log	1.2169	404	0.6045	0.6085	0.6045	0.7775
No log	1.2229	406	0.5113	0.5431	0.5113	0.7151
No log	1.2289	408	0.5141	0.5341	0.5141	0.7170
No log	1.2349	410	0.5797	0.5890	0.5797	0.7614
No log	1.2410	412	0.5818	0.5859	0.5818	0.7627
No log	1.2470	414	0.5180	0.5409	0.5180	0.7197
No log	1.2530	416	0.5190	0.5214	0.5190	0.7205
No log	1.2590	418	0.5646	0.5339	0.5646	0.7514
No log	1.2651	420	0.5798	0.5696	0.5798	0.7615
No log	1.2711	422	0.5575	0.6004	0.5575	0.7467
No log	1.2771	424	0.4537	0.5824	0.4537	0.6735
No log	1.2831	426	0.4111	0.5705	0.4111	0.6412
No log	1.2892	428	0.4151	0.5388	0.4151	0.6443
No log	1.2952	430	0.3907	0.5737	0.3907	0.6251
No log	1.3012	432	0.3818	0.6003	0.3818	0.6179
No log	1.3072	434	0.3918	0.5599	0.3918	0.6259
No log	1.3133	436	0.4417	0.5025	0.4417	0.6646
No log	1.3193	438	0.4010	0.5344	0.4010	0.6332
No log	1.3253	440	0.3930	0.6166	0.3930	0.6269
No log	1.3313	442	0.4862	0.6574	0.4862	0.6973
No log	1.3373	444	0.6188	0.6505	0.6188	0.7867
No log	1.3434	446	0.5829	0.6513	0.5829	0.7635
No log	1.3494	448	0.4792	0.6095	0.4792	0.6923
No log	1.3554	450	0.4474	0.5256	0.4474	0.6689
No log	1.3614	452	0.4590	0.5178	0.4590	0.6775
No log	1.3675	454	0.4685	0.5701	0.4685	0.6845
No log	1.3735	456	0.4354	0.6031	0.4354	0.6598
No log	1.3795	458	0.4036	0.5533	0.4036	0.6353
No log	1.3855	460	0.4440	0.4963	0.4440	0.6664
No log	1.3916	462	0.4178	0.5149	0.4178	0.6463
No log	1.3976	464	0.4140	0.6389	0.4140	0.6434
No log	1.4036	466	0.5198	0.6676	0.5198	0.7210
No log	1.4096	468	0.4730	0.6435	0.4730	0.6878
No log	1.4157	470	0.4154	0.5595	0.4154	0.6445
No log	1.4217	472	0.4113	0.5696	0.4113	0.6414
No log	1.4277	474	0.4438	0.6509	0.4438	0.6662
No log	1.4337	476	0.5069	0.6826	0.5069	0.7120
No log	1.4398	478	0.4424	0.6829	0.4424	0.6651
No log	1.4458	480	0.3942	0.6120	0.3942	0.6279
No log	1.4518	482	0.3959	0.5517	0.3959	0.6292
No log	1.4578	484	0.4028	0.5742	0.4028	0.6347
No log	1.4639	486	0.4481	0.6284	0.4481	0.6694
No log	1.4699	488	0.4389	0.6197	0.4389	0.6625
No log	1.4759	490	0.4036	0.5371	0.4036	0.6353
No log	1.4819	492	0.3990	0.5366	0.3990	0.6317
No log	1.4880	494	0.3900	0.5701	0.3900	0.6245
No log	1.4940	496	0.3945	0.6265	0.3945	0.6281
No log	1.5	498	0.3904	0.6173	0.3904	0.6248
0.5402	1.5060	500	0.4074	0.6301	0.4074	0.6383
0.5402	1.5120	502	0.4201	0.5920	0.4201	0.6481
0.5402	1.5181	504	0.4574	0.5466	0.4574	0.6763
0.5402	1.5241	506	0.4131	0.5669	0.4131	0.6427
0.5402	1.5301	508	0.4058	0.6023	0.4058	0.6370
0.5402	1.5361	510	0.4063	0.5441	0.4063	0.6374

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1