ASAP_FineTuningBERT_AugV4_k1_task1_organization_fold3

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7035
• Qwk: 0.5871
• Mse: 0.7035
• Rmse: 0.8387

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0153	2	11.4846	0.0004	11.4846	3.3889
No log	0.0305	4	10.0402	0.0	10.0402	3.1686
No log	0.0458	6	9.3934	0.0	9.3934	3.0649
No log	0.0611	8	8.5139	0.0	8.5139	2.9179
No log	0.0763	10	7.5541	0.0	7.5541	2.7485
No log	0.0916	12	6.1352	0.0486	6.1352	2.4769
No log	0.1069	14	4.7468	-0.0045	4.7468	2.1787
No log	0.1221	16	3.7370	0.0038	3.7370	1.9331
No log	0.1374	18	3.1165	0.0	3.1165	1.7654
No log	0.1527	20	2.3085	0.1429	2.3085	1.5194
No log	0.1679	22	1.7809	0.0601	1.7809	1.3345
No log	0.1832	24	1.3146	0.0202	1.3146	1.1465
No log	0.1985	26	1.1895	0.0102	1.1895	1.0906
No log	0.2137	28	0.8854	0.2516	0.8854	0.9410
No log	0.2290	30	0.8649	0.1475	0.8649	0.9300
No log	0.2443	32	0.8530	0.0726	0.8530	0.9236
No log	0.2595	34	0.9055	0.0301	0.9055	0.9516
No log	0.2748	36	1.0574	0.0157	1.0574	1.0283
No log	0.2901	38	1.0906	0.0157	1.0906	1.0443
No log	0.3053	40	1.2150	0.0985	1.2150	1.1023
No log	0.3206	42	0.9332	0.0471	0.9332	0.9660
No log	0.3359	44	0.8676	0.2053	0.8676	0.9315
No log	0.3511	46	0.8387	0.1527	0.8387	0.9158
No log	0.3664	48	0.9489	0.0471	0.9489	0.9741
No log	0.3817	50	1.0129	0.0539	1.0129	1.0064
No log	0.3969	52	0.8777	0.0570	0.8777	0.9368
No log	0.4122	54	0.7332	0.2562	0.7332	0.8563
No log	0.4275	56	0.7254	0.3285	0.7254	0.8517
No log	0.4427	58	0.7209	0.1796	0.7209	0.8490
No log	0.4580	60	0.8467	0.0881	0.8467	0.9202
No log	0.4733	62	0.8067	0.1119	0.8067	0.8982
No log	0.4885	64	0.6331	0.3811	0.6331	0.7957
No log	0.5038	66	0.7797	0.3559	0.7797	0.8830
No log	0.5191	68	0.6353	0.4723	0.6353	0.7971
No log	0.5344	70	0.6307	0.2898	0.6307	0.7942
No log	0.5496	72	0.9381	0.3651	0.9381	0.9685
No log	0.5649	74	0.7589	0.4070	0.7589	0.8712
No log	0.5802	76	0.5681	0.4102	0.5681	0.7537
No log	0.5954	78	0.5459	0.4784	0.5459	0.7388
No log	0.6107	80	0.5169	0.4628	0.5169	0.7189
No log	0.6260	82	0.5664	0.5121	0.5664	0.7526
No log	0.6412	84	0.5234	0.5171	0.5234	0.7234
No log	0.6565	86	0.5074	0.5314	0.5074	0.7123
No log	0.6718	88	0.5565	0.5381	0.5565	0.7460
No log	0.6870	90	0.5314	0.5701	0.5314	0.7290
No log	0.7023	92	0.6451	0.4434	0.6451	0.8032
No log	0.7176	94	0.5516	0.5643	0.5516	0.7427
No log	0.7328	96	0.5148	0.6427	0.5148	0.7175
No log	0.7481	98	0.7317	0.4826	0.7317	0.8554
No log	0.7634	100	0.7110	0.5251	0.7110	0.8432
No log	0.7786	102	0.4695	0.6251	0.4695	0.6852
No log	0.7939	104	0.4711	0.5995	0.4711	0.6864
No log	0.8092	106	0.6292	0.5927	0.6292	0.7932
No log	0.8244	108	0.6744	0.5682	0.6744	0.8212
No log	0.8397	110	0.5618	0.6146	0.5618	0.7495
No log	0.8550	112	0.4725	0.6198	0.4725	0.6874
No log	0.8702	114	0.4626	0.6587	0.4626	0.6802
No log	0.8855	116	0.4959	0.6459	0.4959	0.7042
No log	0.9008	118	0.6619	0.5707	0.6619	0.8136
No log	0.9160	120	0.4995	0.6550	0.4995	0.7068
No log	0.9313	122	0.4520	0.6629	0.4520	0.6723
No log	0.9466	124	0.4589	0.6385	0.4589	0.6774
No log	0.9618	126	0.5063	0.6338	0.5063	0.7115
No log	0.9771	128	0.5055	0.6216	0.5055	0.7110
No log	0.9924	130	0.5070	0.6078	0.5070	0.7120
No log	1.0076	132	0.5349	0.5868	0.5349	0.7314
No log	1.0229	134	0.4928	0.5155	0.4928	0.7020
No log	1.0382	136	0.5834	0.5356	0.5834	0.7638
No log	1.0534	138	0.5973	0.5734	0.5973	0.7728
No log	1.0687	140	0.4752	0.6062	0.4752	0.6893
No log	1.0840	142	0.4649	0.6435	0.4649	0.6819
No log	1.0992	144	0.4812	0.6523	0.4812	0.6937
No log	1.1145	146	0.5203	0.6567	0.5203	0.7213
No log	1.1298	148	0.5460	0.6250	0.5460	0.7389
No log	1.1450	150	0.6058	0.6061	0.6058	0.7783
No log	1.1603	152	0.5740	0.6182	0.5740	0.7576
No log	1.1756	154	0.6139	0.5977	0.6139	0.7835
No log	1.1908	156	0.5195	0.6528	0.5195	0.7208
No log	1.2061	158	0.6231	0.5853	0.6231	0.7894
No log	1.2214	160	0.5226	0.6737	0.5226	0.7229
No log	1.2366	162	0.6593	0.5890	0.6593	0.8120
No log	1.2519	164	0.9089	0.5070	0.9089	0.9534
No log	1.2672	166	0.7203	0.5591	0.7203	0.8487
No log	1.2824	168	0.4551	0.6527	0.4551	0.6746
No log	1.2977	170	0.4866	0.6351	0.4866	0.6976
No log	1.3130	172	0.4715	0.6572	0.4715	0.6866
No log	1.3282	174	0.5787	0.6024	0.5787	0.7607
No log	1.3435	176	0.6165	0.5892	0.6165	0.7852
No log	1.3588	178	0.5209	0.6321	0.5209	0.7217
No log	1.3740	180	0.4667	0.6708	0.4667	0.6832
No log	1.3893	182	0.4673	0.6557	0.4673	0.6836
No log	1.4046	184	0.4694	0.6827	0.4694	0.6852
No log	1.4198	186	0.6142	0.5995	0.6142	0.7837
No log	1.4351	188	0.7004	0.5540	0.7004	0.8369
No log	1.4504	190	0.6086	0.6126	0.6086	0.7801
No log	1.4656	192	0.5659	0.6036	0.5659	0.7523
No log	1.4809	194	0.4933	0.6235	0.4933	0.7024
No log	1.4962	196	0.5513	0.6400	0.5513	0.7425
No log	1.5115	198	0.6392	0.5717	0.6392	0.7995
No log	1.5267	200	0.6533	0.5581	0.6533	0.8083
No log	1.5420	202	0.4646	0.6438	0.4646	0.6816
No log	1.5573	204	0.5214	0.5770	0.5214	0.7221
No log	1.5725	206	0.5080	0.5782	0.5080	0.7127
No log	1.5878	208	0.4663	0.6073	0.4663	0.6828
No log	1.6031	210	0.5563	0.6066	0.5563	0.7459
No log	1.6183	212	0.5087	0.6536	0.5087	0.7132
No log	1.6336	214	0.4441	0.6413	0.4441	0.6664
No log	1.6489	216	0.4573	0.6386	0.4573	0.6763
No log	1.6641	218	0.5054	0.6207	0.5054	0.7109
No log	1.6794	220	0.7923	0.4826	0.7923	0.8901
No log	1.6947	222	1.1909	0.3949	1.1909	1.0913
No log	1.7099	224	1.1259	0.4220	1.1259	1.0611
No log	1.7252	226	0.6803	0.5276	0.6803	0.8248
No log	1.7405	228	0.4612	0.6162	0.4612	0.6791
No log	1.7557	230	0.4450	0.6553	0.4450	0.6671
No log	1.7710	232	0.5762	0.6080	0.5762	0.7591
No log	1.7863	234	0.6159	0.5992	0.6159	0.7848
No log	1.8015	236	0.4544	0.6782	0.4544	0.6741
No log	1.8168	238	0.5106	0.6545	0.5106	0.7146
No log	1.8321	240	0.4824	0.6571	0.4824	0.6945
No log	1.8473	242	0.4317	0.6840	0.4317	0.6570
No log	1.8626	244	0.5291	0.6426	0.5291	0.7274
No log	1.8779	246	0.5154	0.6441	0.5154	0.7179
No log	1.8931	248	0.4857	0.6623	0.4857	0.6969
No log	1.9084	250	0.4465	0.6677	0.4465	0.6682
No log	1.9237	252	0.4568	0.6667	0.4568	0.6759
No log	1.9389	254	0.5020	0.6658	0.5020	0.7085
No log	1.9542	256	0.8718	0.5035	0.8718	0.9337
No log	1.9695	258	0.9930	0.4774	0.9930	0.9965
No log	1.9847	260	0.7616	0.5524	0.7616	0.8727
No log	2.0	262	0.4857	0.6809	0.4857	0.6969
No log	2.0153	264	0.4607	0.6887	0.4607	0.6787
No log	2.0305	266	0.5048	0.6595	0.5048	0.7105
No log	2.0458	268	0.7192	0.5670	0.7192	0.8481
No log	2.0611	270	0.7710	0.5429	0.7710	0.8781
No log	2.0763	272	0.6347	0.5812	0.6347	0.7967
No log	2.0916	274	0.4997	0.6397	0.4997	0.7069
No log	2.1069	276	0.5256	0.6415	0.5256	0.7250
No log	2.1221	278	0.6397	0.5987	0.6397	0.7998
No log	2.1374	280	0.5549	0.6370	0.5549	0.7449
No log	2.1527	282	0.4455	0.6992	0.4455	0.6674
No log	2.1679	284	0.4496	0.7015	0.4496	0.6705
No log	2.1832	286	0.4578	0.6938	0.4578	0.6766
No log	2.1985	288	0.4736	0.6954	0.4736	0.6882
No log	2.2137	290	0.5148	0.6649	0.5148	0.7175
No log	2.2290	292	0.6375	0.5910	0.6375	0.7984
No log	2.2443	294	0.6897	0.5498	0.6897	0.8305
No log	2.2595	296	0.8260	0.5118	0.8260	0.9088
No log	2.2748	298	0.8654	0.5098	0.8654	0.9303
No log	2.2901	300	0.5925	0.6000	0.5925	0.7697
No log	2.3053	302	0.4831	0.6484	0.4831	0.6950
No log	2.3206	304	0.4756	0.6827	0.4756	0.6896
No log	2.3359	306	0.4896	0.6830	0.4896	0.6997
No log	2.3511	308	0.4559	0.6955	0.4559	0.6752
No log	2.3664	310	0.4450	0.7014	0.4450	0.6671
No log	2.3817	312	0.4384	0.6975	0.4384	0.6621
No log	2.3969	314	0.4333	0.6942	0.4333	0.6583
No log	2.4122	316	0.4405	0.6839	0.4405	0.6637
No log	2.4275	318	0.4374	0.6721	0.4374	0.6614
No log	2.4427	320	0.6060	0.5863	0.6060	0.7785
No log	2.4580	322	0.8809	0.5183	0.8809	0.9386
No log	2.4733	324	0.7923	0.5203	0.7923	0.8901
No log	2.4885	326	0.4998	0.6435	0.4998	0.7069
No log	2.5038	328	0.4645	0.6490	0.4645	0.6815
No log	2.5191	330	0.5191	0.6574	0.5191	0.7205
No log	2.5344	332	0.7804	0.5426	0.7804	0.8834
No log	2.5496	334	0.8232	0.5413	0.8232	0.9073
No log	2.5649	336	0.5771	0.6280	0.5771	0.7597
No log	2.5802	338	0.4530	0.6595	0.4530	0.6730
No log	2.5954	340	0.4520	0.6618	0.4520	0.6723
No log	2.6107	342	0.4632	0.6502	0.4632	0.6806
No log	2.6260	344	0.4868	0.6904	0.4868	0.6977
No log	2.6412	346	0.4762	0.6707	0.4762	0.6901
No log	2.6565	348	0.4862	0.6419	0.4862	0.6973
No log	2.6718	350	0.4593	0.6606	0.4593	0.6778
No log	2.6870	352	0.5212	0.6531	0.5212	0.7220
No log	2.7023	354	0.5333	0.6510	0.5333	0.7303
No log	2.7176	356	0.4580	0.6515	0.4580	0.6768
No log	2.7328	358	0.4690	0.6491	0.4690	0.6848
No log	2.7481	360	0.5384	0.6411	0.5384	0.7338
No log	2.7634	362	0.5717	0.6324	0.5717	0.7561
No log	2.7786	364	0.6508	0.6000	0.6508	0.8067
No log	2.7939	366	0.5461	0.6449	0.5461	0.7390
No log	2.8092	368	0.4877	0.6887	0.4877	0.6983
No log	2.8244	370	0.5154	0.6651	0.5154	0.7179
No log	2.8397	372	0.6378	0.6295	0.6378	0.7986
No log	2.8550	374	0.5675	0.6443	0.5675	0.7533
No log	2.8702	376	0.5455	0.6560	0.5455	0.7386
No log	2.8855	378	0.5126	0.6725	0.5126	0.7160
No log	2.9008	380	0.5593	0.6529	0.5593	0.7479
No log	2.9160	382	0.6060	0.6128	0.6060	0.7785
No log	2.9313	384	0.5208	0.6616	0.5208	0.7217
No log	2.9466	386	0.5536	0.6335	0.5536	0.7440
No log	2.9618	388	0.6791	0.5687	0.6791	0.8241
No log	2.9771	390	0.6066	0.5912	0.6066	0.7789
No log	2.9924	392	0.5013	0.6692	0.5013	0.7081
No log	3.0076	394	0.5574	0.6223	0.5574	0.7466
No log	3.0229	396	0.7337	0.5540	0.7337	0.8565
No log	3.0382	398	0.6182	0.6091	0.6182	0.7863
No log	3.0534	400	0.4967	0.6784	0.4967	0.7048
No log	3.0687	402	0.5463	0.6651	0.5463	0.7391
No log	3.0840	404	0.6056	0.6423	0.6056	0.7782
No log	3.0992	406	0.5210	0.6696	0.5210	0.7218
No log	3.1145	408	0.5140	0.6840	0.5140	0.7169
No log	3.1298	410	0.5334	0.6750	0.5334	0.7304
No log	3.1450	412	0.5234	0.6856	0.5234	0.7235
No log	3.1603	414	0.4869	0.6856	0.4869	0.6978
No log	3.1756	416	0.4878	0.6795	0.4878	0.6984
No log	3.1908	418	0.5470	0.6546	0.5470	0.7396
No log	3.2061	420	0.7454	0.5428	0.7454	0.8633
No log	3.2214	422	0.6476	0.5856	0.6476	0.8047
No log	3.2366	424	0.5233	0.6440	0.5233	0.7234
No log	3.2519	426	0.5550	0.6366	0.5550	0.7450
No log	3.2672	428	0.7347	0.5572	0.7347	0.8571
No log	3.2824	430	0.6434	0.5859	0.6434	0.8021
No log	3.2977	432	0.4834	0.6610	0.4834	0.6953
No log	3.3130	434	0.4945	0.6313	0.4945	0.7032
No log	3.3282	436	0.4830	0.6661	0.4830	0.6950
No log	3.3435	438	0.5421	0.6505	0.5421	0.7363
No log	3.3588	440	0.4778	0.6597	0.4778	0.6912
No log	3.3740	442	0.4804	0.6532	0.4804	0.6931
No log	3.3893	444	0.5424	0.6499	0.5424	0.7365
No log	3.4046	446	0.7695	0.5534	0.7695	0.8772
No log	3.4198	448	0.6948	0.5778	0.6948	0.8335
No log	3.4351	450	0.5190	0.6434	0.5190	0.7204
No log	3.4504	452	0.5155	0.6269	0.5155	0.7180
No log	3.4656	454	0.5279	0.6413	0.5279	0.7265
No log	3.4809	456	0.6922	0.5754	0.6922	0.8320
No log	3.4962	458	0.6303	0.5865	0.6303	0.7939
No log	3.5115	460	0.5084	0.6305	0.5084	0.7130
No log	3.5267	462	0.4629	0.6387	0.4629	0.6804
No log	3.5420	464	0.4692	0.6423	0.4692	0.6850
No log	3.5573	466	0.4973	0.6481	0.4973	0.7052
No log	3.5725	468	0.6484	0.6009	0.6484	0.8053
No log	3.5878	470	0.6472	0.6028	0.6472	0.8045
No log	3.6031	472	0.5139	0.6574	0.5139	0.7169
No log	3.6183	474	0.4888	0.6587	0.4888	0.6991
No log	3.6336	476	0.5109	0.6345	0.5109	0.7148
No log	3.6489	478	0.6871	0.5699	0.6871	0.8289
No log	3.6641	480	0.7619	0.5404	0.7619	0.8729
No log	3.6794	482	0.6155	0.6151	0.6155	0.7845
No log	3.6947	484	0.5071	0.6410	0.5071	0.7121
No log	3.7099	486	0.5364	0.6381	0.5364	0.7324
No log	3.7252	488	0.7552	0.5662	0.7552	0.8690
No log	3.7405	490	0.9961	0.4950	0.9961	0.9981
No log	3.7557	492	0.8283	0.5545	0.8283	0.9101
No log	3.7710	494	0.5473	0.6590	0.5473	0.7398
No log	3.7863	496	0.4717	0.6722	0.4717	0.6868
No log	3.8015	498	0.4814	0.6639	0.4814	0.6938
0.9613	3.8168	500	0.6013	0.6264	0.6013	0.7754
0.9613	3.8321	502	0.7282	0.5754	0.7282	0.8533
0.9613	3.8473	504	0.6806	0.5801	0.6806	0.8250
0.9613	3.8626	506	0.5471	0.6471	0.5471	0.7397
0.9613	3.8779	508	0.5432	0.6560	0.5432	0.7370
0.9613	3.8931	510	0.6461	0.5977	0.6461	0.8038
0.9613	3.9084	512	0.7013	0.5647	0.7013	0.8375
0.9613	3.9237	514	0.5813	0.6230	0.5813	0.7624
0.9613	3.9389	516	0.4770	0.6638	0.4770	0.6906
0.9613	3.9542	518	0.4865	0.6731	0.4865	0.6975
0.9613	3.9695	520	0.5306	0.6555	0.5306	0.7284
0.9613	3.9847	522	0.5632	0.6409	0.5632	0.7505
0.9613	4.0	524	0.6249	0.6172	0.6249	0.7905
0.9613	4.0153	526	0.5783	0.6375	0.5783	0.7605
0.9613	4.0305	528	0.4996	0.6487	0.4996	0.7068
0.9613	4.0458	530	0.5327	0.6352	0.5327	0.7299
0.9613	4.0611	532	0.7372	0.5983	0.7372	0.8586
0.9613	4.0763	534	0.7690	0.5769	0.7690	0.8770
0.9613	4.0916	536	0.5732	0.6332	0.5732	0.7571
0.9613	4.1069	538	0.4885	0.6704	0.4885	0.6989
0.9613	4.1221	540	0.5246	0.6676	0.5246	0.7243
0.9613	4.1374	542	0.6317	0.6315	0.6317	0.7948
0.9613	4.1527	544	0.5577	0.6542	0.5577	0.7468
0.9613	4.1679	546	0.5701	0.6569	0.5701	0.7550
0.9613	4.1832	548	0.6093	0.6580	0.6093	0.7806
0.9613	4.1985	550	0.6911	0.6207	0.6911	0.8314
0.9613	4.2137	552	0.6925	0.6163	0.6925	0.8322
0.9613	4.2290	554	0.5844	0.6294	0.5844	0.7645
0.9613	4.2443	556	0.5122	0.6547	0.5122	0.7157
0.9613	4.2595	558	0.4907	0.6596	0.4907	0.7005
0.9613	4.2748	560	0.5308	0.6448	0.5308	0.7285
0.9613	4.2901	562	0.6183	0.6136	0.6183	0.7863
0.9613	4.3053	564	0.6251	0.6147	0.6251	0.7906
0.9613	4.3206	566	0.6170	0.6192	0.6170	0.7855
0.9613	4.3359	568	0.7877	0.5603	0.7877	0.8875
0.9613	4.3511	570	0.7035	0.5871	0.7035	0.8387

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1