ASAP_FineTuningBERT_Aug_k25_task1_organization_fold3

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5556
• Qwk: 0.5224
• Mse: 0.5556
• Rmse: 0.7454

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0050	2	9.7520	0.0	9.7520	3.1228
No log	0.0101	4	8.6533	-0.0131	8.6533	2.9417
No log	0.0151	6	7.5175	-0.0003	7.5175	2.7418
No log	0.0202	8	6.4768	0.0	6.4768	2.5450
No log	0.0252	10	5.3497	0.0	5.3497	2.3129
No log	0.0302	12	4.3317	0.0	4.3317	2.0813
No log	0.0353	14	3.6092	0.0302	3.6092	1.8998
No log	0.0403	16	2.6732	0.0	2.6732	1.6350
No log	0.0453	18	2.0411	0.0	2.0411	1.4287
No log	0.0504	20	1.5520	0.0227	1.5520	1.2458
No log	0.0554	22	1.1962	0.0391	1.1962	1.0937
No log	0.0605	24	0.9318	0.0102	0.9318	0.9653
No log	0.0655	26	0.8502	0.0	0.8502	0.9221
No log	0.0705	28	0.8846	0.0	0.8846	0.9405
No log	0.0756	30	1.1044	0.0	1.1044	1.0509
No log	0.0806	32	1.3661	-0.0034	1.3661	1.1688
No log	0.0856	34	0.9442	0.0	0.9442	0.9717
No log	0.0907	36	0.9058	0.0	0.9058	0.9517
No log	0.0957	38	0.9003	0.0	0.9003	0.9488
No log	0.1008	40	0.8676	0.0	0.8676	0.9315
No log	0.1058	42	0.8557	0.0	0.8557	0.9250
No log	0.1108	44	0.8518	0.0	0.8518	0.9229
No log	0.1159	46	0.8772	0.0	0.8772	0.9366
No log	0.1209	48	0.8383	0.0	0.8383	0.9156
No log	0.1259	50	0.8199	0.0	0.8199	0.9055
No log	0.1310	52	0.8398	0.0	0.8398	0.9164
No log	0.1360	54	0.9292	0.0302	0.9292	0.9639
No log	0.1411	56	0.9346	0.0302	0.9346	0.9668
No log	0.1461	58	0.8611	0.0102	0.8611	0.9279
No log	0.1511	60	0.7979	0.0	0.7979	0.8933
No log	0.1562	62	0.8010	0.0046	0.8010	0.8950
No log	0.1612	64	0.8017	0.0	0.8017	0.8954
No log	0.1662	66	0.8431	0.0	0.8431	0.9182
No log	0.1713	68	0.8873	0.0102	0.8873	0.9420
No log	0.1763	70	0.8479	0.0102	0.8479	0.9208
No log	0.1814	72	0.7871	0.0102	0.7871	0.8872
No log	0.1864	74	0.7710	0.0102	0.7710	0.8781
No log	0.1914	76	0.7572	0.0102	0.7572	0.8702
No log	0.1965	78	0.7562	0.0102	0.7562	0.8696
No log	0.2015	80	0.7512	0.0202	0.7512	0.8667
No log	0.2065	82	0.7240	0.0202	0.7240	0.8509
No log	0.2116	84	0.7113	0.0528	0.7113	0.8434
No log	0.2166	86	0.7426	0.0823	0.7426	0.8617
No log	0.2217	88	0.7080	0.0941	0.7080	0.8414
No log	0.2267	90	0.6663	0.2173	0.6663	0.8163
No log	0.2317	92	0.6791	0.3164	0.6791	0.8241
No log	0.2368	94	0.7134	0.3368	0.7134	0.8446
No log	0.2418	96	0.7064	0.3315	0.7064	0.8405
No log	0.2469	98	0.6833	0.2923	0.6833	0.8266
No log	0.2519	100	0.6851	0.2878	0.6851	0.8277
No log	0.2569	102	0.7664	0.2937	0.7664	0.8754
No log	0.2620	104	0.7825	0.3191	0.7825	0.8846
No log	0.2670	106	0.7185	0.3361	0.7185	0.8477
No log	0.2720	108	0.6381	0.3109	0.6381	0.7988
No log	0.2771	110	0.7404	0.1881	0.7404	0.8605
No log	0.2821	112	0.7579	0.1990	0.7579	0.8705
No log	0.2872	114	0.6101	0.3372	0.6101	0.7811
No log	0.2922	116	0.5909	0.3507	0.5909	0.7687
No log	0.2972	118	0.5919	0.3217	0.5919	0.7694
No log	0.3023	120	0.7941	0.1985	0.7941	0.8911
No log	0.3073	122	0.8998	0.1939	0.8998	0.9486
No log	0.3123	124	0.7490	0.2051	0.7490	0.8655
No log	0.3174	126	0.6106	0.3041	0.6106	0.7814
No log	0.3224	128	0.5888	0.3392	0.5888	0.7673
No log	0.3275	130	0.5899	0.3462	0.5899	0.7680
No log	0.3325	132	0.5815	0.4184	0.5815	0.7626
No log	0.3375	134	0.6438	0.4185	0.6438	0.8024
No log	0.3426	136	0.7024	0.3371	0.7024	0.8381
No log	0.3476	138	0.7343	0.1600	0.7343	0.8569
No log	0.3526	140	0.7553	0.1137	0.7553	0.8691
No log	0.3577	142	0.7490	0.0664	0.7490	0.8654
No log	0.3627	144	0.7480	0.0455	0.7480	0.8649
No log	0.3678	146	0.7535	0.0401	0.7535	0.8681
No log	0.3728	148	0.7354	0.0438	0.7354	0.8575
No log	0.3778	150	0.7245	0.2736	0.7245	0.8512
No log	0.3829	152	0.7444	0.3583	0.7444	0.8628
No log	0.3879	154	0.7537	0.3745	0.7537	0.8682
No log	0.3929	156	0.7114	0.3978	0.7114	0.8434
No log	0.3980	158	0.6636	0.2418	0.6636	0.8146
No log	0.4030	160	0.6492	0.2668	0.6492	0.8058
No log	0.4081	162	0.6331	0.3891	0.6331	0.7957
No log	0.4131	164	0.6752	0.4437	0.6752	0.8217
No log	0.4181	166	0.6522	0.4451	0.6522	0.8076
No log	0.4232	168	0.5866	0.4277	0.5866	0.7659
No log	0.4282	170	0.5917	0.3021	0.5917	0.7692
No log	0.4332	172	0.5969	0.2927	0.5969	0.7726
No log	0.4383	174	0.5895	0.3811	0.5895	0.7678
No log	0.4433	176	0.6055	0.4440	0.6055	0.7781
No log	0.4484	178	0.6387	0.4444	0.6387	0.7992
No log	0.4534	180	0.6484	0.4476	0.6484	0.8052
No log	0.4584	182	0.5835	0.4516	0.5835	0.7639
No log	0.4635	184	0.5590	0.4499	0.5590	0.7476
No log	0.4685	186	0.5643	0.4814	0.5643	0.7512
No log	0.4736	188	0.5551	0.5038	0.5551	0.7450
No log	0.4786	190	0.5440	0.5039	0.5440	0.7376
No log	0.4836	192	0.5267	0.5052	0.5267	0.7257
No log	0.4887	194	0.5254	0.5202	0.5254	0.7249
No log	0.4937	196	0.5071	0.4952	0.5071	0.7121
No log	0.4987	198	0.5086	0.5107	0.5086	0.7131
No log	0.5038	200	0.5390	0.5276	0.5390	0.7342
No log	0.5088	202	0.5096	0.4906	0.5096	0.7139
No log	0.5139	204	0.5293	0.4014	0.5293	0.7276
No log	0.5189	206	0.5170	0.4579	0.5170	0.7190
No log	0.5239	208	0.5372	0.5054	0.5372	0.7330
No log	0.5290	210	0.5408	0.4934	0.5408	0.7354
No log	0.5340	212	0.5461	0.4345	0.5461	0.7390
No log	0.5390	214	0.5558	0.4349	0.5558	0.7455
No log	0.5441	216	0.5955	0.4740	0.5955	0.7717
No log	0.5491	218	0.6038	0.4706	0.6038	0.7771
No log	0.5542	220	0.6108	0.4526	0.6108	0.7815
No log	0.5592	222	0.5565	0.4788	0.5565	0.7460
No log	0.5642	224	0.5396	0.3726	0.5396	0.7346
No log	0.5693	226	0.5254	0.3922	0.5254	0.7249
No log	0.5743	228	0.5320	0.4351	0.5320	0.7294
No log	0.5793	230	0.5904	0.3792	0.5904	0.7684
No log	0.5844	232	0.5747	0.3785	0.5747	0.7581
No log	0.5894	234	0.5731	0.3221	0.5731	0.7570
No log	0.5945	236	0.5631	0.3535	0.5631	0.7504
No log	0.5995	238	0.5821	0.4920	0.5821	0.7630
No log	0.6045	240	0.6010	0.4967	0.6010	0.7753
No log	0.6096	242	0.5565	0.4544	0.5565	0.7460
No log	0.6146	244	0.5879	0.3230	0.5879	0.7668
No log	0.6196	246	0.7052	0.2772	0.7052	0.8398
No log	0.6247	248	0.6047	0.3602	0.6047	0.7777
No log	0.6297	250	0.5302	0.4953	0.5302	0.7281
No log	0.6348	252	0.6080	0.5067	0.6080	0.7797
No log	0.6398	254	0.7017	0.4958	0.7017	0.8377
No log	0.6448	256	0.6981	0.4712	0.6981	0.8356
No log	0.6499	258	0.6196	0.4687	0.6196	0.7871
No log	0.6549	260	0.6003	0.4290	0.6003	0.7748
No log	0.6599	262	0.5966	0.4180	0.5966	0.7724
No log	0.6650	264	0.6037	0.4338	0.6037	0.7770
No log	0.6700	266	0.5751	0.4220	0.5751	0.7583
No log	0.6751	268	0.5891	0.3953	0.5891	0.7675
No log	0.6801	270	0.6243	0.3644	0.6243	0.7901
No log	0.6851	272	0.6332	0.3739	0.6332	0.7957
No log	0.6902	274	0.5820	0.4028	0.5820	0.7629
No log	0.6952	276	0.5730	0.4151	0.5730	0.7569
No log	0.7003	278	0.5710	0.4197	0.5710	0.7556
No log	0.7053	280	0.5569	0.4340	0.5569	0.7462
No log	0.7103	282	0.5433	0.4500	0.5433	0.7371
No log	0.7154	284	0.5920	0.5088	0.5920	0.7694
No log	0.7204	286	0.6347	0.5400	0.6347	0.7967
No log	0.7254	288	0.5633	0.5089	0.5633	0.7505
No log	0.7305	290	0.5575	0.5280	0.5575	0.7467
No log	0.7355	292	0.5647	0.5368	0.5647	0.7515
No log	0.7406	294	0.5131	0.4880	0.5131	0.7163
No log	0.7456	296	0.5077	0.4850	0.5077	0.7125
No log	0.7506	298	0.5363	0.5317	0.5363	0.7323
No log	0.7557	300	0.6210	0.5701	0.6210	0.7880
No log	0.7607	302	0.6013	0.5629	0.6013	0.7754
No log	0.7657	304	0.5945	0.5589	0.5945	0.7710
No log	0.7708	306	0.5133	0.5335	0.5133	0.7164
No log	0.7758	308	0.5062	0.5046	0.5062	0.7115
No log	0.7809	310	0.5242	0.5225	0.5242	0.7240
No log	0.7859	312	0.6175	0.5834	0.6175	0.7858
No log	0.7909	314	0.7733	0.5390	0.7733	0.8794
No log	0.7960	316	0.8721	0.5368	0.8721	0.9339
No log	0.8010	318	0.8567	0.5417	0.8567	0.9256
No log	0.8060	320	0.7359	0.5343	0.7359	0.8579
No log	0.8111	322	0.6201	0.5316	0.6201	0.7874
No log	0.8161	324	0.6449	0.5587	0.6449	0.8030
No log	0.8212	326	0.6496	0.5692	0.6496	0.8060
No log	0.8262	328	0.6530	0.5641	0.6530	0.8081
No log	0.8312	330	0.6347	0.5783	0.6347	0.7967
No log	0.8363	332	0.7094	0.6033	0.7094	0.8423
No log	0.8413	334	0.6052	0.6101	0.6052	0.7779
No log	0.8463	336	0.4829	0.4687	0.4829	0.6949
No log	0.8514	338	0.5039	0.3858	0.5039	0.7098
No log	0.8564	340	0.4832	0.4286	0.4832	0.6951
No log	0.8615	342	0.5529	0.5818	0.5529	0.7436
No log	0.8665	344	0.7668	0.6319	0.7668	0.8757
No log	0.8715	346	0.7005	0.6392	0.7005	0.8370
No log	0.8766	348	0.5192	0.5464	0.5192	0.7205
No log	0.8816	350	0.4669	0.4959	0.4669	0.6833
No log	0.8866	352	0.4547	0.5187	0.4547	0.6743
No log	0.8917	354	0.4896	0.6214	0.4896	0.6997
No log	0.8967	356	0.5344	0.6271	0.5344	0.7311
No log	0.9018	358	0.5650	0.5879	0.5650	0.7516
No log	0.9068	360	0.4896	0.5519	0.4896	0.6997
No log	0.9118	362	0.4718	0.4607	0.4718	0.6869
No log	0.9169	364	0.5103	0.3911	0.5103	0.7144
No log	0.9219	366	0.4858	0.4303	0.4858	0.6970
No log	0.9270	368	0.5186	0.5399	0.5186	0.7201
No log	0.9320	370	0.6726	0.5547	0.6726	0.8201
No log	0.9370	372	0.7266	0.5445	0.7266	0.8524
No log	0.9421	374	0.6030	0.5578	0.6030	0.7765
No log	0.9471	376	0.4861	0.5024	0.4861	0.6972
No log	0.9521	378	0.4749	0.4841	0.4749	0.6891
No log	0.9572	380	0.4867	0.5196	0.4867	0.6976
No log	0.9622	382	0.5880	0.6109	0.5880	0.7668
No log	0.9673	384	0.6338	0.6099	0.6338	0.7961
No log	0.9723	386	0.5397	0.5866	0.5397	0.7346
No log	0.9773	388	0.4731	0.5384	0.4731	0.6878
No log	0.9824	390	0.4640	0.5449	0.4640	0.6812
No log	0.9874	392	0.4843	0.5738	0.4843	0.6959
No log	0.9924	394	0.5482	0.6089	0.5482	0.7404
No log	0.9975	396	0.5979	0.6313	0.5979	0.7732
No log	1.0025	398	0.5444	0.6133	0.5444	0.7378
No log	1.0076	400	0.4692	0.5555	0.4692	0.6850
No log	1.0126	402	0.4673	0.5556	0.4673	0.6836
No log	1.0176	404	0.4933	0.5553	0.4933	0.7023
No log	1.0227	406	0.5472	0.5814	0.5472	0.7397
No log	1.0277	408	0.5850	0.6674	0.5850	0.7649
No log	1.0327	410	0.5383	0.6550	0.5383	0.7337
No log	1.0378	412	0.4838	0.6250	0.4838	0.6955
No log	1.0428	414	0.4444	0.5784	0.4444	0.6666
No log	1.0479	416	0.4410	0.5748	0.4410	0.6641
No log	1.0529	418	0.5457	0.6920	0.5457	0.7387
No log	1.0579	420	0.8469	0.6664	0.8469	0.9203
No log	1.0630	422	0.8600	0.6559	0.8600	0.9274
No log	1.0680	424	0.6393	0.6514	0.6393	0.7996
No log	1.0730	426	0.5659	0.6186	0.5659	0.7523
No log	1.0781	428	0.6438	0.6188	0.6438	0.8024
No log	1.0831	430	0.9242	0.5879	0.9242	0.9613
No log	1.0882	432	1.0173	0.5624	1.0173	1.0086
No log	1.0932	434	0.8290	0.6346	0.8290	0.9105
No log	1.0982	436	0.6078	0.6363	0.6078	0.7796
No log	1.1033	438	0.5590	0.6142	0.5590	0.7476
No log	1.1083	440	0.6503	0.6396	0.6503	0.8064
No log	1.1134	442	0.7739	0.6313	0.7739	0.8797
No log	1.1184	444	0.8502	0.6452	0.8502	0.9220
No log	1.1234	446	0.7136	0.6977	0.7136	0.8447
No log	1.1285	448	0.5650	0.6386	0.5650	0.7517
No log	1.1335	450	0.5577	0.6102	0.5577	0.7468
No log	1.1385	452	0.5719	0.6153	0.5719	0.7562
No log	1.1436	454	0.5583	0.6054	0.5583	0.7472
No log	1.1486	456	0.5642	0.6237	0.5642	0.7512
No log	1.1537	458	0.6436	0.6663	0.6436	0.8023
No log	1.1587	460	0.5888	0.6438	0.5888	0.7673
No log	1.1637	462	0.5000	0.5865	0.5000	0.7071
No log	1.1688	464	0.4963	0.5872	0.4963	0.7045
No log	1.1738	466	0.5059	0.5484	0.5059	0.7112
No log	1.1788	468	0.5773	0.5564	0.5773	0.7598
No log	1.1839	470	0.6057	0.5129	0.6057	0.7783
No log	1.1889	472	0.5604	0.4631	0.5604	0.7486
No log	1.1940	474	0.5590	0.4561	0.5590	0.7477
No log	1.1990	476	0.5697	0.4616	0.5697	0.7548
No log	1.2040	478	0.5601	0.4519	0.5601	0.7484
No log	1.2091	480	0.5532	0.4285	0.5532	0.7438
No log	1.2141	482	0.5529	0.4711	0.5529	0.7436
No log	1.2191	484	0.5829	0.5230	0.5829	0.7635
No log	1.2242	486	0.5502	0.5387	0.5502	0.7418
No log	1.2292	488	0.5390	0.5369	0.5390	0.7342
No log	1.2343	490	0.5133	0.4771	0.5133	0.7165
No log	1.2393	492	0.5008	0.4814	0.5008	0.7077
No log	1.2443	494	0.5070	0.5654	0.5070	0.7121
No log	1.2494	496	0.5102	0.5793	0.5102	0.7143
No log	1.2544	498	0.4905	0.5732	0.4905	0.7003
0.497	1.2594	500	0.5127	0.5977	0.5127	0.7161
0.497	1.2645	502	0.4903	0.5851	0.4903	0.7002
0.497	1.2695	504	0.4803	0.5344	0.4803	0.6930
0.497	1.2746	506	0.4867	0.5307	0.4867	0.6977
0.497	1.2796	508	0.5392	0.6002	0.5392	0.7343
0.497	1.2846	510	0.5621	0.5935	0.5621	0.7497
0.497	1.2897	512	0.5588	0.5680	0.5588	0.7475
0.497	1.2947	514	0.5423	0.5241	0.5423	0.7364
0.497	1.2997	516	0.5627	0.5325	0.5627	0.7502
0.497	1.3048	518	0.5556	0.5224	0.5556	0.7454

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1