ASAP_FineTuningBERT_Aug_k25_task1_organization_fold0

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.4564
• Qwk: 0.5184
• Mse: 0.4564
• Rmse: 0.6756

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0051	2	9.7197	0.0	9.7197	3.1176
No log	0.0103	4	8.2513	0.0137	8.2513	2.8725
No log	0.0154	6	7.2426	0.0054	7.2426	2.6912
No log	0.0206	8	6.5605	0.0018	6.5605	2.5614
No log	0.0257	10	5.7007	0.0	5.7007	2.3876
No log	0.0308	12	4.8602	0.0	4.8602	2.2046
No log	0.0360	14	4.0732	0.0312	4.0732	2.0182
No log	0.0411	16	3.3232	0.0150	3.3232	1.8230
No log	0.0463	18	2.6070	0.0115	2.6070	1.6146
No log	0.0514	20	2.0523	0.0077	2.0523	1.4326
No log	0.0566	22	1.5454	0.0077	1.5454	1.2431
No log	0.0617	24	1.2206	0.0976	1.2206	1.1048
No log	0.0668	26	0.9968	0.0484	0.9968	0.9984
No log	0.0720	28	0.8412	0.0316	0.8412	0.9172
No log	0.0771	30	0.7720	0.0316	0.7720	0.8786
No log	0.0823	32	0.7483	0.0316	0.7483	0.8650
No log	0.0874	34	0.7221	0.0316	0.7221	0.8498
No log	0.0925	36	0.6818	0.0679	0.6818	0.8257
No log	0.0977	38	0.6879	0.2823	0.6879	0.8294
No log	0.1028	40	0.7261	0.4454	0.7261	0.8521
No log	0.1080	42	0.6917	0.0316	0.6917	0.8317
No log	0.1131	44	0.7032	0.0316	0.7032	0.8386
No log	0.1183	46	0.6912	0.0409	0.6912	0.8314
No log	0.1234	48	0.7595	0.1049	0.7595	0.8715
No log	0.1285	50	0.7885	0.0316	0.7885	0.8880
No log	0.1337	52	0.8640	0.0316	0.8640	0.9295
No log	0.1388	54	0.8273	0.0316	0.8273	0.9096
No log	0.1440	56	0.7669	0.0316	0.7669	0.8757
No log	0.1491	58	0.7488	0.0316	0.7488	0.8653
No log	0.1542	60	0.7392	0.0316	0.7392	0.8598
No log	0.1594	62	0.8688	0.0316	0.8688	0.9321
No log	0.1645	64	0.7803	0.0316	0.7803	0.8833
No log	0.1697	66	0.7587	0.0917	0.7587	0.8710
No log	0.1748	68	0.8153	0.1893	0.8153	0.9029
No log	0.1799	70	0.8050	0.0106	0.8050	0.8972
No log	0.1851	72	0.7948	0.0106	0.7948	0.8915
No log	0.1902	74	0.8814	0.0106	0.8814	0.9388
No log	0.1954	76	0.9010	0.0106	0.9010	0.9492
No log	0.2005	78	0.8501	0.0106	0.8501	0.9220
No log	0.2057	80	0.8026	0.0106	0.8026	0.8959
No log	0.2108	82	0.7781	0.0212	0.7781	0.8821
No log	0.2159	84	0.7539	0.0212	0.7539	0.8683
No log	0.2211	86	0.7138	0.0212	0.7138	0.8449
No log	0.2262	88	0.6840	0.0316	0.6840	0.8270
No log	0.2314	90	0.6716	0.0382	0.6716	0.8195
No log	0.2365	92	0.7469	0.1138	0.7469	0.8642
No log	0.2416	94	0.6904	0.0989	0.6904	0.8309
No log	0.2468	96	0.6409	0.0965	0.6409	0.8006
No log	0.2519	98	0.5906	0.1657	0.5906	0.7685
No log	0.2571	100	0.5836	0.3276	0.5836	0.7640
No log	0.2622	102	0.5813	0.2713	0.5813	0.7624
No log	0.2674	104	0.6539	0.2029	0.6539	0.8086
No log	0.2725	106	0.6165	0.1761	0.6165	0.7852
No log	0.2776	108	0.6649	0.2300	0.6649	0.8154
No log	0.2828	110	0.5761	0.3670	0.5761	0.7590
No log	0.2879	112	0.6440	0.2348	0.6440	0.8025
No log	0.2931	114	0.5790	0.3560	0.5790	0.7609
No log	0.2982	116	0.5972	0.4462	0.5972	0.7728
No log	0.3033	118	0.5890	0.4195	0.5890	0.7674
No log	0.3085	120	0.6041	0.4154	0.6041	0.7773
No log	0.3136	122	0.6236	0.4118	0.6236	0.7897
No log	0.3188	124	0.6326	0.3870	0.6326	0.7954
No log	0.3239	126	0.6408	0.3804	0.6408	0.8005
No log	0.3290	128	0.6351	0.2678	0.6351	0.7969
No log	0.3342	130	0.6273	0.2938	0.6273	0.7921
No log	0.3393	132	0.6098	0.3983	0.6098	0.7809
No log	0.3445	134	0.5610	0.3395	0.5610	0.7490
No log	0.3496	136	0.5803	0.2881	0.5803	0.7618
No log	0.3548	138	0.6078	0.2697	0.6078	0.7796
No log	0.3599	140	0.5420	0.3548	0.5420	0.7362
No log	0.3650	142	0.6176	0.4748	0.6176	0.7859
No log	0.3702	144	0.6974	0.4289	0.6974	0.8351
No log	0.3753	146	0.6100	0.4760	0.6100	0.7810
No log	0.3805	148	0.5638	0.3984	0.5638	0.7509
No log	0.3856	150	0.5885	0.3725	0.5885	0.7672
No log	0.3907	152	0.6188	0.4020	0.6188	0.7866
No log	0.3959	154	0.6011	0.4209	0.6011	0.7753
No log	0.4010	156	0.5802	0.3927	0.5802	0.7617
No log	0.4062	158	0.6003	0.2077	0.6003	0.7748
No log	0.4113	160	0.6117	0.1512	0.6117	0.7821
No log	0.4165	162	0.5686	0.3428	0.5686	0.7541
No log	0.4216	164	0.5838	0.4219	0.5838	0.7641
No log	0.4267	166	0.5672	0.2763	0.5672	0.7531
No log	0.4319	168	0.6833	0.1056	0.6833	0.8266
No log	0.4370	170	0.6518	0.1132	0.6518	0.8074
No log	0.4422	172	0.5972	0.1976	0.5972	0.7728
No log	0.4473	174	0.5658	0.2990	0.5658	0.7522
No log	0.4524	176	0.5975	0.4283	0.5975	0.7730
No log	0.4576	178	0.5976	0.4283	0.5976	0.7731
No log	0.4627	180	0.5860	0.3942	0.5860	0.7655
No log	0.4679	182	0.5564	0.3634	0.5564	0.7459
No log	0.4730	184	0.5481	0.3261	0.5481	0.7404
No log	0.4781	186	0.5404	0.3953	0.5404	0.7351
No log	0.4833	188	0.6461	0.4499	0.6461	0.8038
No log	0.4884	190	0.6761	0.4304	0.6761	0.8222
No log	0.4936	192	0.5535	0.4554	0.5535	0.7440
No log	0.4987	194	0.5418	0.3669	0.5418	0.7361
No log	0.5039	196	0.5403	0.3481	0.5403	0.7350
No log	0.5090	198	0.5639	0.4450	0.5639	0.7509
No log	0.5141	200	0.5816	0.4289	0.5816	0.7626
No log	0.5193	202	0.5499	0.4539	0.5499	0.7416
No log	0.5244	204	0.5273	0.3763	0.5273	0.7261
No log	0.5296	206	0.5654	0.2645	0.5654	0.7519
No log	0.5347	208	0.5674	0.2675	0.5674	0.7532
No log	0.5398	210	0.5249	0.3926	0.5249	0.7245
No log	0.5450	212	0.5320	0.4558	0.5320	0.7294
No log	0.5501	214	0.5117	0.3944	0.5117	0.7154
No log	0.5553	216	0.5569	0.3028	0.5569	0.7462
No log	0.5604	218	0.5266	0.3504	0.5266	0.7257
No log	0.5656	220	0.4845	0.4490	0.4845	0.6961
No log	0.5707	222	0.5231	0.5271	0.5231	0.7233
No log	0.5758	224	0.4822	0.4886	0.4822	0.6944
No log	0.5810	226	0.4878	0.3970	0.4878	0.6984
No log	0.5861	228	0.4745	0.4288	0.4745	0.6888
No log	0.5913	230	0.5477	0.5292	0.5477	0.7401
No log	0.5964	232	0.6008	0.5223	0.6008	0.7751
No log	0.6015	234	0.5149	0.5206	0.5149	0.7175
No log	0.6067	236	0.4841	0.4222	0.4841	0.6958
No log	0.6118	238	0.5127	0.3362	0.5127	0.7160
No log	0.6170	240	0.4975	0.3923	0.4975	0.7053
No log	0.6221	242	0.5268	0.5096	0.5268	0.7258
No log	0.6272	244	0.6378	0.5017	0.6378	0.7986
No log	0.6324	246	0.5999	0.5175	0.5999	0.7745
No log	0.6375	248	0.4988	0.5016	0.4988	0.7063
No log	0.6427	250	0.4872	0.4214	0.4872	0.6980
No log	0.6478	252	0.5091	0.3482	0.5091	0.7135
No log	0.6530	254	0.4968	0.3697	0.4968	0.7049
No log	0.6581	256	0.4635	0.5082	0.4635	0.6808
No log	0.6632	258	0.5824	0.5396	0.5824	0.7631
No log	0.6684	260	0.5973	0.5489	0.5973	0.7729
No log	0.6735	262	0.5086	0.5418	0.5086	0.7132
No log	0.6787	264	0.4792	0.4449	0.4792	0.6922
No log	0.6838	266	0.5579	0.3627	0.5579	0.7469
No log	0.6889	268	0.5398	0.3697	0.5398	0.7347
No log	0.6941	270	0.4788	0.4614	0.4788	0.6920
No log	0.6992	272	0.5757	0.5162	0.5757	0.7587
No log	0.7044	274	0.6351	0.4778	0.6351	0.7969
No log	0.7095	276	0.5685	0.4801	0.5685	0.7540
No log	0.7147	278	0.5609	0.3805	0.5609	0.7489
No log	0.7198	280	0.5666	0.3615	0.5666	0.7527
No log	0.7249	282	0.5373	0.4395	0.5373	0.7330
No log	0.7301	284	0.5215	0.4876	0.5215	0.7221
No log	0.7352	286	0.4933	0.4565	0.4933	0.7024
No log	0.7404	288	0.5489	0.3641	0.5489	0.7409
No log	0.7455	290	0.6123	0.3346	0.6123	0.7825
No log	0.7506	292	0.5541	0.4180	0.5541	0.7444
No log	0.7558	294	0.4790	0.4901	0.4790	0.6921
No log	0.7609	296	0.4686	0.5074	0.4686	0.6846
No log	0.7661	298	0.4663	0.4929	0.4663	0.6829
No log	0.7712	300	0.4666	0.5431	0.4666	0.6831
No log	0.7763	302	0.4872	0.5412	0.4872	0.6980
No log	0.7815	304	0.4857	0.5417	0.4857	0.6969
No log	0.7866	306	0.4833	0.5466	0.4833	0.6952
No log	0.7918	308	0.4925	0.5549	0.4925	0.7018
No log	0.7969	310	0.4739	0.5404	0.4739	0.6884
No log	0.8021	312	0.4711	0.5205	0.4711	0.6863
No log	0.8072	314	0.5007	0.5171	0.5007	0.7076
No log	0.8123	316	0.5579	0.5316	0.5579	0.7469
No log	0.8175	318	0.5392	0.5250	0.5392	0.7343
No log	0.8226	320	0.5354	0.5256	0.5354	0.7317
No log	0.8278	322	0.5253	0.4336	0.5253	0.7248
No log	0.8329	324	0.5250	0.4681	0.5250	0.7246
No log	0.8380	326	0.5320	0.5253	0.5320	0.7294
No log	0.8432	328	0.4825	0.5053	0.4825	0.6946
No log	0.8483	330	0.4667	0.4666	0.4667	0.6832
No log	0.8535	332	0.4557	0.5208	0.4557	0.6750
No log	0.8586	334	0.4649	0.5286	0.4649	0.6818
No log	0.8638	336	0.4720	0.5408	0.4720	0.6870
No log	0.8689	338	0.4720	0.5090	0.4720	0.6870
No log	0.8740	340	0.4633	0.5394	0.4633	0.6807
No log	0.8792	342	0.4862	0.5372	0.4862	0.6973
No log	0.8843	344	0.5721	0.5510	0.5721	0.7564
No log	0.8895	346	0.7939	0.4588	0.7939	0.8910
No log	0.8946	348	0.8576	0.3951	0.8576	0.9260
No log	0.8997	350	0.6966	0.4815	0.6966	0.8346
No log	0.9049	352	0.5705	0.5189	0.5705	0.7553
No log	0.9100	354	0.5220	0.5013	0.5220	0.7225
No log	0.9152	356	0.5820	0.5494	0.5820	0.7629
No log	0.9203	358	0.7439	0.5036	0.7439	0.8625
No log	0.9254	360	0.6732	0.5195	0.6732	0.8205
No log	0.9306	362	0.4886	0.5138	0.4886	0.6990
No log	0.9357	364	0.4985	0.4153	0.4985	0.7061
No log	0.9409	366	0.5227	0.3879	0.5227	0.7230
No log	0.9460	368	0.4700	0.4772	0.4700	0.6856
No log	0.9512	370	0.5071	0.5468	0.5071	0.7121
No log	0.9563	372	0.5819	0.5450	0.5819	0.7628
No log	0.9614	374	0.5248	0.5394	0.5248	0.7244
No log	0.9666	376	0.4763	0.4821	0.4763	0.6901
No log	0.9717	378	0.4905	0.4417	0.4905	0.7004
No log	0.9769	380	0.4829	0.4738	0.4829	0.6949
No log	0.9820	382	0.5657	0.5193	0.5657	0.7521
No log	0.9871	384	0.7036	0.5190	0.7036	0.8388
No log	0.9923	386	0.6313	0.5412	0.6313	0.7945
No log	0.9974	388	0.4861	0.4993	0.4861	0.6972
No log	1.0026	390	0.4721	0.4625	0.4721	0.6871
No log	1.0077	392	0.4816	0.4456	0.4816	0.6940
No log	1.0129	394	0.4607	0.4838	0.4607	0.6787
No log	1.0180	396	0.4668	0.5060	0.4668	0.6832
No log	1.0231	398	0.4631	0.5200	0.4631	0.6805
No log	1.0283	400	0.4655	0.4533	0.4655	0.6823
No log	1.0334	402	0.5081	0.4148	0.5081	0.7128
No log	1.0386	404	0.4766	0.4245	0.4766	0.6904
No log	1.0437	406	0.4818	0.4912	0.4818	0.6941
No log	1.0488	408	0.5238	0.5213	0.5238	0.7238
No log	1.0540	410	0.4926	0.4612	0.4926	0.7019
No log	1.0591	412	0.5061	0.4156	0.5061	0.7114
No log	1.0643	414	0.5041	0.4209	0.5041	0.7100
No log	1.0694	416	0.5551	0.4780	0.5551	0.7451
No log	1.0746	418	0.5774	0.5102	0.5774	0.7599
No log	1.0797	420	0.5050	0.5034	0.5050	0.7106
No log	1.0848	422	0.4807	0.5015	0.4807	0.6933
No log	1.0900	424	0.4769	0.5189	0.4769	0.6906
No log	1.0951	426	0.4694	0.5283	0.4694	0.6851
No log	1.1003	428	0.4423	0.4854	0.4423	0.6650
No log	1.1054	430	0.4369	0.5068	0.4369	0.6610
No log	1.1105	432	0.4454	0.5455	0.4454	0.6674
No log	1.1157	434	0.4437	0.5512	0.4437	0.6661
No log	1.1208	436	0.4562	0.4929	0.4562	0.6754
No log	1.1260	438	0.4602	0.4870	0.4602	0.6783
No log	1.1311	440	0.4457	0.5258	0.4457	0.6676
No log	1.1362	442	0.4608	0.5101	0.4608	0.6788
No log	1.1414	444	0.4760	0.5264	0.4760	0.6899
No log	1.1465	446	0.5298	0.5349	0.5298	0.7279
No log	1.1517	448	0.5108	0.5336	0.5108	0.7147
No log	1.1568	450	0.5328	0.5322	0.5328	0.7299
No log	1.1620	452	0.5035	0.5248	0.5035	0.7096
No log	1.1671	454	0.5211	0.5226	0.5211	0.7219
No log	1.1722	456	0.4861	0.5296	0.4861	0.6972
No log	1.1774	458	0.4699	0.4930	0.4699	0.6855
No log	1.1825	460	0.4989	0.5226	0.4989	0.7063
No log	1.1877	462	0.6440	0.5366	0.6440	0.8025
No log	1.1928	464	0.7441	0.5185	0.7441	0.8626
No log	1.1979	466	0.6323	0.5209	0.6323	0.7952
No log	1.2031	468	0.4717	0.5118	0.4717	0.6868
No log	1.2082	470	0.4499	0.4895	0.4499	0.6708
No log	1.2134	472	0.4587	0.5022	0.4587	0.6773
No log	1.2185	474	0.5473	0.5565	0.5473	0.7398
No log	1.2237	476	0.5294	0.5544	0.5294	0.7276
No log	1.2288	478	0.4768	0.5068	0.4768	0.6905
No log	1.2339	480	0.4621	0.5117	0.4621	0.6798
No log	1.2391	482	0.4542	0.5083	0.4542	0.6739
No log	1.2442	484	0.4625	0.5366	0.4625	0.6801
No log	1.2494	486	0.4630	0.5530	0.4630	0.6804
No log	1.2545	488	0.4324	0.5327	0.4324	0.6576
No log	1.2596	490	0.4783	0.4953	0.4783	0.6916
No log	1.2648	492	0.4386	0.5386	0.4386	0.6623
No log	1.2699	494	0.5001	0.5708	0.5001	0.7072
No log	1.2751	496	0.4724	0.5244	0.4724	0.6873
No log	1.2802	498	0.4831	0.5095	0.4831	0.6950
0.5324	1.2853	500	0.5707	0.5382	0.5707	0.7554
0.5324	1.2905	502	0.6423	0.5507	0.6423	0.8014
0.5324	1.2956	504	0.5986	0.5476	0.5986	0.7737
0.5324	1.3008	506	0.4654	0.5226	0.4654	0.6822
0.5324	1.3059	508	0.5024	0.3636	0.5024	0.7088
0.5324	1.3111	510	0.5388	0.3602	0.5388	0.7340
0.5324	1.3162	512	0.4840	0.4043	0.4840	0.6957
0.5324	1.3213	514	0.4564	0.5184	0.4564	0.6756

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1