ASAP_FineTuningBERT_Aug_k25_task1_organization_fold4

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.4891
• Qwk: 0.6171
• Mse: 0.4891
• Rmse: 0.6994

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0052	2	10.6601	0.0	10.6601	3.2650
No log	0.0103	4	7.8616	0.0194	7.8616	2.8039
No log	0.0155	6	7.0896	0.0048	7.0896	2.6626
No log	0.0206	8	6.1073	0.0018	6.1073	2.4713
No log	0.0258	10	5.4397	0.0018	5.4397	2.3323
No log	0.0309	12	4.7953	0.0018	4.7953	2.1898
No log	0.0361	14	3.9731	-0.0028	3.9731	1.9933
No log	0.0412	16	3.2237	0.0156	3.2237	1.7955
No log	0.0464	18	2.6377	0.0156	2.6377	1.6241
No log	0.0515	20	2.1053	0.0118	2.1053	1.4510
No log	0.0567	22	1.6804	0.0079	1.6805	1.2963
No log	0.0619	24	1.3708	0.1180	1.3708	1.1708
No log	0.0670	26	1.1475	0.0518	1.1475	1.0712
No log	0.0722	28	0.9627	0.0420	0.9627	0.9812
No log	0.0773	30	0.8651	0.0316	0.8651	0.9301
No log	0.0825	32	0.8569	0.0212	0.8569	0.9257
No log	0.0876	34	0.8782	0.0212	0.8782	0.9371
No log	0.0928	36	0.9044	0.0212	0.9044	0.9510
No log	0.0979	38	0.8495	0.0316	0.8495	0.9217
No log	0.1031	40	0.9447	0.0432	0.9447	0.9720
No log	0.1082	42	0.8097	0.0212	0.8097	0.8998
No log	0.1134	44	0.8189	0.0462	0.8189	0.9049
No log	0.1186	46	0.7802	0.0328	0.7802	0.8833
No log	0.1237	48	0.7616	0.0420	0.7616	0.8727
No log	0.1289	50	0.7440	0.0420	0.7440	0.8625
No log	0.1340	52	0.7480	0.0522	0.7480	0.8649
No log	0.1392	54	0.8701	0.0682	0.8701	0.9328
No log	0.1443	56	0.8648	0.0610	0.8648	0.9299
No log	0.1495	58	0.8081	0.0107	0.8081	0.8990
No log	0.1546	60	0.8783	0.0107	0.8783	0.9372
No log	0.1598	62	0.9082	0.0107	0.9082	0.9530
No log	0.1649	64	0.9310	0.0107	0.9310	0.9649
No log	0.1701	66	0.9892	0.0107	0.9892	0.9946
No log	0.1753	68	0.9739	0.0107	0.9739	0.9868
No log	0.1804	70	0.9110	0.0107	0.9110	0.9545
No log	0.1856	72	0.8796	0.0107	0.8796	0.9379
No log	0.1907	74	0.8478	0.0107	0.8478	0.9208
No log	0.1959	76	0.8494	0.0107	0.8494	0.9216
No log	0.2010	78	0.8899	0.0107	0.8899	0.9433
No log	0.2062	80	0.8566	0.0107	0.8566	0.9255
No log	0.2113	82	0.8380	0.0107	0.8380	0.9154
No log	0.2165	84	0.8533	0.0107	0.8533	0.9238
No log	0.2216	86	0.8232	0.0107	0.8232	0.9073
No log	0.2268	88	0.7923	0.0107	0.7923	0.8901
No log	0.2320	90	0.8300	0.0421	0.8300	0.9111
No log	0.2371	92	0.7628	0.0317	0.7628	0.8734
No log	0.2423	94	0.7850	0.1462	0.7850	0.8860
No log	0.2474	96	0.7927	0.2629	0.7927	0.8904
No log	0.2526	98	0.7354	0.0317	0.7354	0.8576
No log	0.2577	100	0.7851	0.0675	0.7851	0.8860
No log	0.2629	102	0.7573	0.0421	0.7573	0.8703
No log	0.2680	104	0.7326	0.0317	0.7326	0.8559
No log	0.2732	106	0.7933	0.3270	0.7933	0.8907
No log	0.2784	108	0.7715	0.2928	0.7715	0.8783
No log	0.2835	110	0.7094	0.0648	0.7094	0.8423
No log	0.2887	112	0.7206	0.0766	0.7206	0.8489
No log	0.2938	114	0.6994	0.0675	0.6994	0.8363
No log	0.2990	116	0.6923	0.0593	0.6923	0.8321
No log	0.3041	118	0.7393	0.2883	0.7393	0.8599
No log	0.3093	120	0.7268	0.2431	0.7268	0.8525
No log	0.3144	122	0.6761	0.0561	0.6761	0.8223
No log	0.3196	124	0.7442	0.1554	0.7442	0.8627
No log	0.3247	126	0.7078	0.1374	0.7078	0.8413
No log	0.3299	128	0.6522	0.0735	0.6522	0.8076
No log	0.3351	130	0.7363	0.1057	0.7363	0.8581
No log	0.3402	132	0.7562	0.0352	0.7562	0.8696
No log	0.3454	134	0.7320	0.0382	0.7320	0.8556
No log	0.3505	136	0.7098	0.0574	0.7098	0.8425
No log	0.3557	138	0.7152	0.0708	0.7152	0.8457
No log	0.3608	140	0.7071	0.0900	0.7071	0.8409
No log	0.3660	142	0.7001	0.0981	0.7001	0.8367
No log	0.3711	144	0.7199	0.1353	0.7199	0.8485
No log	0.3763	146	0.7104	0.1753	0.7104	0.8429
No log	0.3814	148	0.6449	0.1388	0.6449	0.8030
No log	0.3866	150	0.6480	0.2153	0.6480	0.8050
No log	0.3918	152	0.6256	0.4367	0.6256	0.7909
No log	0.3969	154	0.5721	0.4351	0.5721	0.7564
No log	0.4021	156	0.6115	0.2846	0.6115	0.7820
No log	0.4072	158	0.6905	0.2747	0.6905	0.8310
No log	0.4124	160	0.6387	0.2400	0.6387	0.7992
No log	0.4175	162	0.6840	0.1298	0.6840	0.8270
No log	0.4227	164	0.7778	0.0805	0.7778	0.8820
No log	0.4278	166	0.8412	0.1441	0.8412	0.9171
No log	0.4330	168	0.7992	0.3936	0.7992	0.8940
No log	0.4381	170	0.7000	0.2547	0.7000	0.8366
No log	0.4433	172	0.6744	0.1090	0.6744	0.8212
No log	0.4485	174	0.6631	0.1719	0.6631	0.8143
No log	0.4536	176	0.6732	0.3615	0.6732	0.8205
No log	0.4588	178	0.6760	0.4076	0.6760	0.8222
No log	0.4639	180	0.6323	0.4396	0.6323	0.7952
No log	0.4691	182	0.5769	0.3126	0.5769	0.7596
No log	0.4742	184	0.5743	0.2814	0.5743	0.7578
No log	0.4794	186	0.5733	0.2900	0.5733	0.7572
No log	0.4845	188	0.6072	0.4538	0.6072	0.7792
No log	0.4897	190	0.5926	0.4029	0.5926	0.7698
No log	0.4948	192	0.5831	0.2198	0.5831	0.7636
No log	0.5	194	0.5948	0.2275	0.5948	0.7712
No log	0.5052	196	0.5588	0.2950	0.5588	0.7475
No log	0.5103	198	0.5549	0.4528	0.5549	0.7449
No log	0.5155	200	0.5440	0.4315	0.5440	0.7376
No log	0.5206	202	0.5903	0.2734	0.5903	0.7683
No log	0.5258	204	0.6137	0.2715	0.6137	0.7834
No log	0.5309	206	0.5520	0.3607	0.5520	0.7430
No log	0.5361	208	0.6206	0.4728	0.6206	0.7878
No log	0.5412	210	0.6511	0.4183	0.6511	0.8069
No log	0.5464	212	0.6221	0.4293	0.6221	0.7887
No log	0.5515	214	0.6249	0.4443	0.6249	0.7905
No log	0.5567	216	0.6353	0.5180	0.6353	0.7970
No log	0.5619	218	0.5927	0.4850	0.5927	0.7699
No log	0.5670	220	0.5722	0.4189	0.5722	0.7564
No log	0.5722	222	0.5404	0.3692	0.5404	0.7351
No log	0.5773	224	0.5235	0.4421	0.5235	0.7235
No log	0.5825	226	0.5066	0.5178	0.5066	0.7117
No log	0.5876	228	0.4905	0.4623	0.4905	0.7004
No log	0.5928	230	0.4816	0.4910	0.4816	0.6940
No log	0.5979	232	0.5005	0.6126	0.5005	0.7074
No log	0.6031	234	0.6134	0.5536	0.6134	0.7832
No log	0.6082	236	0.5385	0.6098	0.5385	0.7338
No log	0.6134	238	0.4824	0.5961	0.4824	0.6945
No log	0.6186	240	0.4920	0.5887	0.4920	0.7014
No log	0.6237	242	0.5138	0.6125	0.5138	0.7168
No log	0.6289	244	0.5174	0.5971	0.5174	0.7193
No log	0.6340	246	0.5087	0.5934	0.5087	0.7132
No log	0.6392	248	0.5120	0.5850	0.5120	0.7155
No log	0.6443	250	0.5183	0.5810	0.5183	0.7199
No log	0.6495	252	0.5113	0.5322	0.5113	0.7151
No log	0.6546	254	0.5029	0.5484	0.5029	0.7092
No log	0.6598	256	0.5437	0.5834	0.5437	0.7374
No log	0.6649	258	0.5765	0.5971	0.5765	0.7593
No log	0.6701	260	0.5174	0.5446	0.5174	0.7193
No log	0.6753	262	0.5611	0.2879	0.5611	0.7491
No log	0.6804	264	0.5544	0.3068	0.5544	0.7446
No log	0.6856	266	0.5300	0.5151	0.5300	0.7280
No log	0.6907	268	0.6208	0.5300	0.6208	0.7879
No log	0.6959	270	0.6111	0.5561	0.6111	0.7817
No log	0.7010	272	0.5087	0.5784	0.5087	0.7132
No log	0.7062	274	0.5132	0.4089	0.5132	0.7163
No log	0.7113	276	0.5338	0.3829	0.5338	0.7306
No log	0.7165	278	0.4777	0.5415	0.4777	0.6912
No log	0.7216	280	0.5047	0.5773	0.5047	0.7104
No log	0.7268	282	0.5220	0.5699	0.5220	0.7225
No log	0.7320	284	0.4909	0.5252	0.4909	0.7007
No log	0.7371	286	0.4859	0.4588	0.4859	0.6971
No log	0.7423	288	0.4887	0.5587	0.4887	0.6991
No log	0.7474	290	0.6058	0.5687	0.6058	0.7784
No log	0.7526	292	0.5904	0.5835	0.5904	0.7684
No log	0.7577	294	0.4815	0.5105	0.4815	0.6939
No log	0.7629	296	0.4958	0.4431	0.4958	0.7042
No log	0.7680	298	0.4934	0.5009	0.4934	0.7024
No log	0.7732	300	0.5734	0.5940	0.5734	0.7572
No log	0.7784	302	0.5460	0.5983	0.5460	0.7389
No log	0.7835	304	0.4574	0.5560	0.4574	0.6763
No log	0.7887	306	0.4811	0.4771	0.4811	0.6936
No log	0.7938	308	0.4566	0.5497	0.4566	0.6757
No log	0.7990	310	0.4686	0.4989	0.4686	0.6845
No log	0.8041	312	0.4548	0.5481	0.4548	0.6744
No log	0.8093	314	0.4859	0.5918	0.4859	0.6971
No log	0.8144	316	0.5375	0.5888	0.5375	0.7332
No log	0.8196	318	0.5434	0.5777	0.5434	0.7372
No log	0.8247	320	0.5639	0.5330	0.5639	0.7510
No log	0.8299	322	0.6431	0.5524	0.6431	0.8019
No log	0.8351	324	0.7925	0.5106	0.7925	0.8902
No log	0.8402	326	0.8008	0.4877	0.8008	0.8949
No log	0.8454	328	0.7665	0.4458	0.7665	0.8755
No log	0.8505	330	0.8005	0.4563	0.8005	0.8947
No log	0.8557	332	0.6495	0.4362	0.6495	0.8059
No log	0.8608	334	0.5907	0.3736	0.5907	0.7685
No log	0.8660	336	0.5578	0.4397	0.5578	0.7468
No log	0.8711	338	0.5451	0.5071	0.5451	0.7383
No log	0.8763	340	0.5235	0.5319	0.5235	0.7235
No log	0.8814	342	0.4888	0.5563	0.4888	0.6991
No log	0.8866	344	0.4779	0.4861	0.4779	0.6913
No log	0.8918	346	0.4667	0.5237	0.4667	0.6831
No log	0.8969	348	0.5817	0.5845	0.5817	0.7627
No log	0.9021	350	0.6557	0.5757	0.6557	0.8098
No log	0.9072	352	0.5097	0.6065	0.5097	0.7139
No log	0.9124	354	0.4729	0.5883	0.4729	0.6877
No log	0.9175	356	0.5084	0.6149	0.5084	0.7130
No log	0.9227	358	0.6036	0.5894	0.6036	0.7769
No log	0.9278	360	0.5317	0.6102	0.5317	0.7292
No log	0.9330	362	0.4917	0.5274	0.4917	0.7012
No log	0.9381	364	0.5366	0.4608	0.5366	0.7325
No log	0.9433	366	0.4825	0.5087	0.4825	0.6946
No log	0.9485	368	0.4709	0.5522	0.4709	0.6862
No log	0.9536	370	0.4711	0.5794	0.4711	0.6864
No log	0.9588	372	0.4750	0.5802	0.4750	0.6892
No log	0.9639	374	0.4795	0.5716	0.4795	0.6924
No log	0.9691	376	0.4878	0.5551	0.4878	0.6984
No log	0.9742	378	0.4884	0.5483	0.4884	0.6989
No log	0.9794	380	0.5627	0.4668	0.5627	0.7501
No log	0.9845	382	0.5340	0.4692	0.5340	0.7307
No log	0.9897	384	0.4754	0.5330	0.4754	0.6895
No log	0.9948	386	0.5329	0.5766	0.5329	0.7300
No log	1.0	388	0.7023	0.5376	0.7023	0.8380
No log	1.0052	390	0.6659	0.5331	0.6659	0.8160
No log	1.0103	392	0.6137	0.4680	0.6137	0.7834
No log	1.0155	394	0.6050	0.4224	0.6050	0.7778
No log	1.0206	396	0.6534	0.4861	0.6534	0.8084
No log	1.0258	398	0.8771	0.4683	0.8771	0.9366
No log	1.0309	400	0.8512	0.4797	0.8512	0.9226
No log	1.0361	402	0.6227	0.5241	0.6227	0.7891
No log	1.0412	404	0.5586	0.5538	0.5586	0.7474
No log	1.0464	406	0.6091	0.5865	0.6091	0.7804
No log	1.0515	408	0.7132	0.5793	0.7132	0.8445
No log	1.0567	410	0.6226	0.5801	0.6226	0.7891
No log	1.0619	412	0.4911	0.5702	0.4911	0.7008
No log	1.0670	414	0.4791	0.5285	0.4791	0.6922
No log	1.0722	416	0.4955	0.5984	0.4955	0.7039
No log	1.0773	418	0.4920	0.6029	0.4920	0.7014
No log	1.0825	420	0.4868	0.5782	0.4868	0.6977
No log	1.0876	422	0.5462	0.5102	0.5462	0.7391
No log	1.0928	424	0.5504	0.5199	0.5504	0.7419
No log	1.0979	426	0.5392	0.6113	0.5392	0.7343
No log	1.1031	428	0.5359	0.6098	0.5359	0.7321
No log	1.1082	430	0.4717	0.5563	0.4717	0.6868
No log	1.1134	432	0.4709	0.5424	0.4709	0.6862
No log	1.1186	434	0.5502	0.5656	0.5502	0.7417
No log	1.1237	436	0.6334	0.5649	0.6334	0.7959
No log	1.1289	438	0.5924	0.5815	0.5924	0.7697
No log	1.1340	440	0.5201	0.5783	0.5201	0.7212
No log	1.1392	442	0.5280	0.5889	0.5280	0.7267
No log	1.1443	444	0.6308	0.5820	0.6308	0.7942
No log	1.1495	446	0.6403	0.5732	0.6403	0.8002
No log	1.1546	448	0.5869	0.5761	0.5869	0.7661
No log	1.1598	450	0.5659	0.5855	0.5659	0.7523
No log	1.1649	452	0.5538	0.5901	0.5538	0.7442
No log	1.1701	454	0.5058	0.6009	0.5058	0.7112
No log	1.1753	456	0.5297	0.6153	0.5297	0.7278
No log	1.1804	458	0.5605	0.6179	0.5605	0.7487
No log	1.1856	460	0.4971	0.6125	0.4971	0.7050
No log	1.1907	462	0.4608	0.5652	0.4608	0.6788
No log	1.1959	464	0.4640	0.5758	0.4640	0.6811
No log	1.2010	466	0.4747	0.5860	0.4747	0.6890
No log	1.2062	468	0.4929	0.6053	0.4929	0.7021
No log	1.2113	470	0.4892	0.5950	0.4892	0.6994
No log	1.2165	472	0.4784	0.5332	0.4784	0.6917
No log	1.2216	474	0.4851	0.5707	0.4851	0.6965
No log	1.2268	476	0.4928	0.5312	0.4928	0.7020
No log	1.2320	478	0.4858	0.5629	0.4858	0.6970
No log	1.2371	480	0.6451	0.6056	0.6451	0.8032
No log	1.2423	482	0.7069	0.5829	0.7069	0.8408
No log	1.2474	484	0.5217	0.6101	0.5217	0.7223
No log	1.2526	486	0.4834	0.5629	0.4834	0.6953
No log	1.2577	488	0.5480	0.6171	0.5480	0.7403
No log	1.2629	490	0.5804	0.6026	0.5804	0.7618
No log	1.2680	492	0.5486	0.6173	0.5486	0.7407
No log	1.2732	494	0.4630	0.5704	0.4630	0.6804
No log	1.2784	496	0.4564	0.5748	0.4564	0.6755
No log	1.2835	498	0.5503	0.6362	0.5503	0.7419
0.5527	1.2887	500	0.8261	0.6445	0.8261	0.9089
0.5527	1.2938	502	0.7760	0.6621	0.7760	0.8809
0.5527	1.2990	504	0.5159	0.6175	0.5159	0.7183
0.5527	1.3041	506	0.4639	0.4889	0.4639	0.6811
0.5527	1.3093	508	0.5108	0.4270	0.5108	0.7147
0.5527	1.3144	510	0.4657	0.4817	0.4657	0.6824
0.5527	1.3196	512	0.4891	0.6171	0.4891	0.6994

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1