ASAP_FineTuningBERT_Aug_k5_task1_organization_fold4

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5677
• Qwk: 0.7007
• Mse: 0.5677
• Rmse: 0.7534

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0190	2	8.6874	0.0083	8.6874	2.9474
No log	0.0381	4	7.7044	0.0074	7.7044	2.7757
No log	0.0571	6	6.9518	0.0018	6.9518	2.6366
No log	0.0762	8	5.9679	0.0018	5.9679	2.4429
No log	0.0952	10	4.8453	0.0018	4.8453	2.2012
No log	0.1143	12	3.7791	0.0595	3.7791	1.9440
No log	0.1333	14	3.1396	0.0138	3.1397	1.7719
No log	0.1524	16	2.4795	0.0040	2.4795	1.5747
No log	0.1714	18	2.0691	0.0040	2.0691	1.4384
No log	0.1905	20	1.5416	0.0040	1.5416	1.2416
No log	0.2095	22	1.2438	0.0996	1.2438	1.1152
No log	0.2286	24	1.0621	0.0316	1.0621	1.0306
No log	0.2476	26	0.9220	0.0212	0.9220	0.9602
No log	0.2667	28	0.8884	0.0238	0.8884	0.9426
No log	0.2857	30	0.8471	0.0212	0.8471	0.9204
No log	0.3048	32	0.8742	0.0212	0.8742	0.9350
No log	0.3238	34	0.8797	0.0107	0.8797	0.9379
No log	0.3429	36	0.9688	0.0107	0.9688	0.9843
No log	0.3619	38	0.8858	0.0107	0.8858	0.9412
No log	0.3810	40	0.8386	0.0212	0.8386	0.9157
No log	0.4	42	0.8179	0.0212	0.8179	0.9044
No log	0.4190	44	0.7712	0.0212	0.7712	0.8782
No log	0.4381	46	0.7180	0.0683	0.7180	0.8474
No log	0.4571	48	0.7002	0.4200	0.7002	0.8368
No log	0.4762	50	0.6120	0.3430	0.6120	0.7823
No log	0.4952	52	0.6335	0.1299	0.6335	0.7959
No log	0.5143	54	0.6101	0.1419	0.6101	0.7811
No log	0.5333	56	0.6845	0.1780	0.6845	0.8273
No log	0.5524	58	0.6283	0.1673	0.6283	0.7927
No log	0.5714	60	0.5990	0.4477	0.5990	0.7739
No log	0.5905	62	0.6396	0.4941	0.6396	0.7997
No log	0.6095	64	0.5899	0.1808	0.5899	0.7680
No log	0.6286	66	0.6982	0.2241	0.6982	0.8356
No log	0.6476	68	0.7756	0.2320	0.7756	0.8807
No log	0.6667	70	0.7160	0.2103	0.7160	0.8462
No log	0.6857	72	0.7326	0.1216	0.7326	0.8559
No log	0.7048	74	0.7159	0.1055	0.7159	0.8461
No log	0.7238	76	0.7309	0.0975	0.7309	0.8549
No log	0.7429	78	0.7047	0.1207	0.7047	0.8395
No log	0.7619	80	0.5974	0.2017	0.5974	0.7729
No log	0.7810	82	0.5955	0.2389	0.5955	0.7717
No log	0.8	84	0.6995	0.2592	0.6995	0.8364
No log	0.8190	86	0.6224	0.2740	0.6224	0.7889
No log	0.8381	88	0.5607	0.3005	0.5607	0.7488
No log	0.8571	90	0.5699	0.2702	0.5699	0.7549
No log	0.8762	92	0.5847	0.2469	0.5847	0.7647
No log	0.8952	94	0.5945	0.3417	0.5945	0.7711
No log	0.9143	96	0.5890	0.3145	0.5890	0.7675
No log	0.9333	98	0.5658	0.3671	0.5658	0.7522
No log	0.9524	100	0.5416	0.4128	0.5416	0.7359
No log	0.9714	102	0.5381	0.4652	0.5381	0.7335
No log	0.9905	104	0.5495	0.4437	0.5495	0.7413
No log	1.0095	106	0.5747	0.4681	0.5747	0.7581
No log	1.0286	108	0.5952	0.5315	0.5952	0.7715
No log	1.0476	110	0.5299	0.5326	0.5299	0.7280
No log	1.0667	112	0.4974	0.5583	0.4974	0.7052
No log	1.0857	114	0.4946	0.5803	0.4946	0.7033
No log	1.1048	116	0.4852	0.5506	0.4852	0.6966
No log	1.1238	118	0.4846	0.5508	0.4846	0.6961
No log	1.1429	120	0.4891	0.5832	0.4891	0.6994
No log	1.1619	122	0.5942	0.6014	0.5942	0.7708
No log	1.1810	124	0.6632	0.5729	0.6632	0.8144
No log	1.2	126	0.6567	0.5711	0.6567	0.8104
No log	1.2190	128	0.5892	0.5910	0.5892	0.7676
No log	1.2381	130	0.5092	0.5888	0.5092	0.7136
No log	1.2571	132	0.5933	0.5838	0.5933	0.7703
No log	1.2762	134	0.7703	0.5188	0.7703	0.8777
No log	1.2952	136	0.6612	0.5640	0.6612	0.8131
No log	1.3143	138	0.4472	0.5771	0.4472	0.6688
No log	1.3333	140	0.4698	0.4578	0.4698	0.6854
No log	1.3524	142	0.4580	0.4840	0.4580	0.6768
No log	1.3714	144	0.4919	0.5730	0.4919	0.7013
No log	1.3905	146	0.5936	0.5885	0.5936	0.7705
No log	1.4095	148	0.5425	0.5769	0.5425	0.7366
No log	1.4286	150	0.4663	0.4985	0.4663	0.6829
No log	1.4476	152	0.5809	0.3454	0.5809	0.7622
No log	1.4667	154	0.6326	0.3530	0.6326	0.7954
No log	1.4857	156	0.5213	0.4299	0.5213	0.7220
No log	1.5048	158	0.4655	0.5473	0.4655	0.6823
No log	1.5238	160	0.5404	0.5549	0.5404	0.7351
No log	1.5429	162	0.5309	0.5523	0.5309	0.7286
No log	1.5619	164	0.4765	0.5596	0.4765	0.6903
No log	1.5810	166	0.4783	0.5799	0.4783	0.6916
No log	1.6	168	0.5238	0.5831	0.5238	0.7237
No log	1.6190	170	0.5086	0.5904	0.5086	0.7132
No log	1.6381	172	0.5405	0.6025	0.5405	0.7352
No log	1.6571	174	0.5179	0.5732	0.5179	0.7196
No log	1.6762	176	0.5047	0.5388	0.5047	0.7104
No log	1.6952	178	0.5265	0.5245	0.5265	0.7256
No log	1.7143	180	0.4971	0.5466	0.4971	0.7050
No log	1.7333	182	0.5065	0.5769	0.5065	0.7117
No log	1.7524	184	0.6637	0.5920	0.6637	0.8147
No log	1.7714	186	0.7273	0.5750	0.7273	0.8528
No log	1.7905	188	0.5994	0.5978	0.5994	0.7742
No log	1.8095	190	0.4526	0.5771	0.4526	0.6727
No log	1.8286	192	0.4406	0.5772	0.4406	0.6638
No log	1.8476	194	0.4399	0.5904	0.4399	0.6633
No log	1.8667	196	0.4452	0.6012	0.4452	0.6673
No log	1.8857	198	0.4353	0.5886	0.4353	0.6598
No log	1.9048	200	0.4380	0.5960	0.4380	0.6618
No log	1.9238	202	0.4378	0.5848	0.4378	0.6617
No log	1.9429	204	0.4455	0.5454	0.4455	0.6675
No log	1.9619	206	0.4400	0.5875	0.4400	0.6633
No log	1.9810	208	0.4942	0.6067	0.4942	0.7030
No log	2.0	210	0.5499	0.6009	0.5499	0.7415
No log	2.0190	212	0.4883	0.6015	0.4883	0.6988
No log	2.0381	214	0.4918	0.6038	0.4918	0.7013
No log	2.0571	216	0.5462	0.5966	0.5462	0.7391
No log	2.0762	218	0.5010	0.6004	0.5010	0.7078
No log	2.0952	220	0.4825	0.6076	0.4825	0.6946
No log	2.1143	222	0.4994	0.6056	0.4994	0.7067
No log	2.1333	224	0.5181	0.6092	0.5181	0.7198
No log	2.1524	226	0.4670	0.6143	0.4670	0.6834
No log	2.1714	228	0.4285	0.6087	0.4285	0.6546
No log	2.1905	230	0.4561	0.6196	0.4561	0.6753
No log	2.2095	232	0.5733	0.6190	0.5733	0.7572
No log	2.2286	234	0.5267	0.6191	0.5267	0.7258
No log	2.2476	236	0.4602	0.6112	0.4602	0.6783
No log	2.2667	238	0.4392	0.6084	0.4392	0.6627
No log	2.2857	240	0.4493	0.6204	0.4493	0.6703
No log	2.3048	242	0.5219	0.6473	0.5219	0.7224
No log	2.3238	244	0.4751	0.6465	0.4751	0.6893
No log	2.3429	246	0.4385	0.5977	0.4385	0.6622
No log	2.3619	248	0.4732	0.6530	0.4732	0.6879
No log	2.3810	250	0.5374	0.6566	0.5374	0.7331
No log	2.4	252	0.4968	0.6540	0.4968	0.7048
No log	2.4190	254	0.5071	0.6634	0.5071	0.7121
No log	2.4381	256	0.5339	0.6594	0.5339	0.7307
No log	2.4571	258	0.4756	0.6325	0.4756	0.6897
No log	2.4762	260	0.4966	0.6421	0.4966	0.7047
No log	2.4952	262	0.5139	0.6268	0.5139	0.7169
No log	2.5143	264	0.5290	0.6357	0.5290	0.7273
No log	2.5333	266	0.4939	0.6357	0.4939	0.7028
No log	2.5524	268	0.5121	0.6679	0.5121	0.7156
No log	2.5714	270	0.4834	0.6666	0.4834	0.6953
No log	2.5905	272	0.4753	0.6539	0.4753	0.6894
No log	2.6095	274	0.4890	0.6662	0.4890	0.6993
No log	2.6286	276	0.5176	0.6673	0.5176	0.7194
No log	2.6476	278	0.5322	0.6763	0.5322	0.7295
No log	2.6667	280	0.5292	0.6706	0.5292	0.7274
No log	2.6857	282	0.4690	0.6357	0.4690	0.6848
No log	2.7048	284	0.4831	0.6390	0.4831	0.6951
No log	2.7238	286	0.4930	0.6432	0.4930	0.7022
No log	2.7429	288	0.4397	0.6011	0.4397	0.6631
No log	2.7619	290	0.4318	0.5879	0.4318	0.6571
No log	2.7810	292	0.4563	0.5893	0.4563	0.6755
No log	2.8	294	0.5197	0.6195	0.5197	0.7209
No log	2.8190	296	0.4976	0.5851	0.4976	0.7054
No log	2.8381	298	0.4387	0.5618	0.4387	0.6624
No log	2.8571	300	0.4428	0.5710	0.4428	0.6654
No log	2.8762	302	0.4992	0.6165	0.4992	0.7065
No log	2.8952	304	0.5088	0.6280	0.5088	0.7133
No log	2.9143	306	0.4597	0.6058	0.4597	0.6780
No log	2.9333	308	0.4497	0.5586	0.4497	0.6706
No log	2.9524	310	0.4724	0.5709	0.4724	0.6873
No log	2.9714	312	0.4838	0.5743	0.4838	0.6956
No log	2.9905	314	0.5058	0.6530	0.5058	0.7112
No log	3.0095	316	0.5588	0.6753	0.5588	0.7475
No log	3.0286	318	0.5639	0.6839	0.5639	0.7510
No log	3.0476	320	0.5162	0.6910	0.5162	0.7185
No log	3.0667	322	0.4950	0.6767	0.4950	0.7036
No log	3.0857	324	0.4819	0.6782	0.4819	0.6942
No log	3.1048	326	0.4374	0.6277	0.4374	0.6614
No log	3.1238	328	0.4486	0.6704	0.4486	0.6698
No log	3.1429	330	0.4264	0.6055	0.4264	0.6530
No log	3.1619	332	0.4406	0.5353	0.4406	0.6638
No log	3.1810	334	0.4314	0.5298	0.4314	0.6568
No log	3.2	336	0.4202	0.6064	0.4202	0.6483
No log	3.2190	338	0.6467	0.6772	0.6467	0.8042
No log	3.2381	340	0.8811	0.6475	0.8811	0.9387
No log	3.2571	342	0.7795	0.6513	0.7795	0.8829
No log	3.2762	344	0.4841	0.6332	0.4841	0.6957
No log	3.2952	346	0.4289	0.5369	0.4289	0.6549
No log	3.3143	348	0.4312	0.5758	0.4312	0.6566
No log	3.3333	350	0.4721	0.6445	0.4721	0.6871
No log	3.3524	352	0.5414	0.6842	0.5414	0.7358
No log	3.3714	354	0.6609	0.6753	0.6609	0.8130
No log	3.3905	356	0.5441	0.7097	0.5441	0.7376
No log	3.4095	358	0.4351	0.6500	0.4351	0.6596
No log	3.4286	360	0.4208	0.5873	0.4208	0.6487
No log	3.4476	362	0.4341	0.6550	0.4341	0.6589
No log	3.4667	364	0.5046	0.6866	0.5046	0.7104
No log	3.4857	366	0.5495	0.6871	0.5495	0.7413
No log	3.5048	368	0.4823	0.6836	0.4823	0.6944
No log	3.5238	370	0.4425	0.6509	0.4425	0.6652
No log	3.5429	372	0.4547	0.6600	0.4547	0.6743
No log	3.5619	374	0.5321	0.6889	0.5321	0.7295
No log	3.5810	376	0.5633	0.6973	0.5633	0.7505
No log	3.6	378	0.5964	0.7059	0.5964	0.7722
No log	3.6190	380	0.5256	0.6902	0.5256	0.7250
No log	3.6381	382	0.4470	0.6655	0.4470	0.6686
No log	3.6571	384	0.4664	0.6703	0.4664	0.6829
No log	3.6762	386	0.4958	0.6860	0.4958	0.7042
No log	3.6952	388	0.5978	0.6886	0.5978	0.7732
No log	3.7143	390	0.5089	0.6896	0.5089	0.7133
No log	3.7333	392	0.4275	0.5968	0.4275	0.6539
No log	3.7524	394	0.4840	0.4976	0.4840	0.6957
No log	3.7714	396	0.4763	0.5187	0.4763	0.6902
No log	3.7905	398	0.4623	0.6262	0.4623	0.6799
No log	3.8095	400	0.5607	0.7016	0.5607	0.7488
No log	3.8286	402	0.5329	0.6785	0.5329	0.7300
No log	3.8476	404	0.4593	0.6081	0.4593	0.6777
No log	3.8667	406	0.4659	0.5325	0.4659	0.6826
No log	3.8857	408	0.4509	0.5323	0.4509	0.6715
No log	3.9048	410	0.4365	0.6456	0.4365	0.6607
No log	3.9238	412	0.6149	0.7104	0.6149	0.7842
No log	3.9429	414	0.7383	0.6997	0.7383	0.8592
No log	3.9619	416	0.6329	0.7085	0.6329	0.7955
No log	3.9810	418	0.4625	0.6581	0.4625	0.6801
No log	4.0	420	0.4246	0.5960	0.4246	0.6516
No log	4.0190	422	0.4298	0.5602	0.4298	0.6556
No log	4.0381	424	0.4329	0.6328	0.4329	0.6580
No log	4.0571	426	0.5020	0.6724	0.5020	0.7085
No log	4.0762	428	0.5432	0.6834	0.5432	0.7370
No log	4.0952	430	0.4826	0.6607	0.4826	0.6947
No log	4.1143	432	0.4525	0.6423	0.4525	0.6727
No log	4.1333	434	0.4371	0.6231	0.4371	0.6611
No log	4.1524	436	0.4531	0.6515	0.4531	0.6732
No log	4.1714	438	0.5301	0.6735	0.5301	0.7281
No log	4.1905	440	0.7234	0.6828	0.7234	0.8505
No log	4.2095	442	0.7042	0.6842	0.7042	0.8392
No log	4.2286	444	0.5129	0.6739	0.5129	0.7162
No log	4.2476	446	0.4352	0.6081	0.4352	0.6597
No log	4.2667	448	0.4380	0.6130	0.4380	0.6618
No log	4.2857	450	0.4768	0.6700	0.4768	0.6905
No log	4.3048	452	0.5915	0.6817	0.5915	0.7691
No log	4.3238	454	0.5552	0.6820	0.5552	0.7451
No log	4.3429	456	0.4569	0.6431	0.4569	0.6759
No log	4.3619	458	0.4555	0.5601	0.4555	0.6749
No log	4.3810	460	0.4492	0.5933	0.4492	0.6702
No log	4.4	462	0.4827	0.6749	0.4827	0.6947
No log	4.4190	464	0.5514	0.6812	0.5514	0.7426
No log	4.4381	466	0.5201	0.6737	0.5201	0.7212
No log	4.4571	468	0.4659	0.6620	0.4659	0.6826
No log	4.4762	470	0.4985	0.6888	0.4985	0.7060
No log	4.4952	472	0.6297	0.6961	0.6297	0.7935
No log	4.5143	474	0.6538	0.6890	0.6538	0.8086
No log	4.5333	476	0.5544	0.6835	0.5544	0.7446
No log	4.5524	478	0.4912	0.6725	0.4912	0.7008
No log	4.5714	480	0.5191	0.6915	0.5191	0.7205
No log	4.5905	482	0.5230	0.6874	0.5230	0.7232
No log	4.6095	484	0.4770	0.6482	0.4770	0.6906
No log	4.6286	486	0.4862	0.6550	0.4862	0.6973
No log	4.6476	488	0.5563	0.6950	0.5563	0.7459
No log	4.6667	490	0.5947	0.7006	0.5947	0.7711
No log	4.6857	492	0.4855	0.6701	0.4855	0.6968
No log	4.7048	494	0.4417	0.5767	0.4417	0.6646
No log	4.7238	496	0.4384	0.5784	0.4384	0.6621
No log	4.7429	498	0.4722	0.6625	0.4722	0.6872
0.5603	4.7619	500	0.5582	0.7061	0.5582	0.7471
0.5603	4.7810	502	0.7218	0.6788	0.7218	0.8496
0.5603	4.8	504	0.6643	0.6905	0.6643	0.8151
0.5603	4.8190	506	0.5823	0.6950	0.5823	0.7631
0.5603	4.8381	508	0.5285	0.6956	0.5285	0.7270
0.5603	4.8571	510	0.5677	0.7007	0.5677	0.7534

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1