ASAP_FineTuningBERT_AugV4_k3_task1_organization_fold3

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6595
• Qwk: 0.5541
• Mse: 0.6595
• Rmse: 0.8121

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0062	2	13.2701	-0.0011	13.2701	3.6428
No log	0.0123	4	9.1036	0.0054	9.1036	3.0172
No log	0.0185	6	6.5561	0.0052	6.5561	2.5605
No log	0.0247	8	5.6407	0.0088	5.6407	2.3750
No log	0.0309	10	4.9912	0.0213	4.9912	2.2341
No log	0.0370	12	4.7350	0.0114	4.7350	2.1760
No log	0.0432	14	4.0668	0.0114	4.0668	2.0166
No log	0.0494	16	3.7653	0.0076	3.7653	1.9404
No log	0.0556	18	3.2919	0.0038	3.2919	1.8144
No log	0.0617	20	2.9704	0.0	2.9704	1.7235
No log	0.0679	22	2.6783	0.0	2.6783	1.6365
No log	0.0741	24	2.4050	0.0757	2.4050	1.5508
No log	0.0802	26	2.1791	0.0834	2.1791	1.4762
No log	0.0864	28	1.9016	0.0788	1.9016	1.3790
No log	0.0926	30	1.6897	0.0202	1.6897	1.2999
No log	0.0988	32	1.4111	0.0102	1.4111	1.1879
No log	0.1049	34	1.1530	0.0	1.1530	1.0738
No log	0.1111	36	0.9782	0.1447	0.9782	0.9890
No log	0.1173	38	0.8983	0.1217	0.8983	0.9478
No log	0.1235	40	0.8926	0.0585	0.8926	0.9448
No log	0.1296	42	0.9308	0.0314	0.9308	0.9648
No log	0.1358	44	0.9769	0.0314	0.9769	0.9884
No log	0.1420	46	1.0888	0.0461	1.0888	1.0435
No log	0.1481	48	1.4595	0.0994	1.4595	1.2081
No log	0.1543	50	1.2407	0.0877	1.2407	1.1139
No log	0.1605	52	0.9317	0.0314	0.9317	0.9652
No log	0.1667	54	0.8923	0.0514	0.8923	0.9446
No log	0.1728	56	0.9636	0.0314	0.9636	0.9817
No log	0.1790	58	1.1501	0.0157	1.1501	1.0724
No log	0.1852	60	1.1340	0.0517	1.1340	1.0649
No log	0.1914	62	0.8779	0.0471	0.8779	0.9370
No log	0.1975	64	0.8993	0.0471	0.8993	0.9483
No log	0.2037	66	1.2062	0.1432	1.2062	1.0983
No log	0.2099	68	1.2013	0.1386	1.2013	1.0960
No log	0.2160	70	0.8204	0.1228	0.8204	0.9058
No log	0.2222	72	0.8272	0.2306	0.8272	0.9095
No log	0.2284	74	0.9189	0.0482	0.9189	0.9586
No log	0.2346	76	1.4368	0.1658	1.4368	1.1987
No log	0.2407	78	1.3451	0.2178	1.3451	1.1598
No log	0.2469	80	0.9885	0.0471	0.9885	0.9942
No log	0.2531	82	0.7047	0.2475	0.7047	0.8395
No log	0.2593	84	0.6758	0.3759	0.6758	0.8221
No log	0.2654	86	0.6516	0.3300	0.6516	0.8072
No log	0.2716	88	0.7155	0.2089	0.7155	0.8459
No log	0.2778	90	0.6878	0.2565	0.6878	0.8294
No log	0.2840	92	0.6007	0.4256	0.6007	0.7751
No log	0.2901	94	0.7873	0.4365	0.7873	0.8873
No log	0.2963	96	0.8274	0.4411	0.8274	0.9096
No log	0.3025	98	0.5801	0.4898	0.5801	0.7616
No log	0.3086	100	0.7242	0.2659	0.7242	0.8510
No log	0.3148	102	0.8927	0.2191	0.8927	0.9448
No log	0.3210	104	0.8708	0.2280	0.8708	0.9332
No log	0.3272	106	0.7552	0.3011	0.7552	0.8690
No log	0.3333	108	0.6682	0.4110	0.6682	0.8175
No log	0.3395	110	0.6564	0.5094	0.6564	0.8102
No log	0.3457	112	1.0465	0.4473	1.0465	1.0230
No log	0.3519	114	1.2639	0.3708	1.2639	1.1242
No log	0.3580	116	0.7748	0.4468	0.7748	0.8802
No log	0.3642	118	0.5785	0.4574	0.5785	0.7606
No log	0.3704	120	0.6477	0.3189	0.6477	0.8048
No log	0.3765	122	0.6204	0.3297	0.6204	0.7876
No log	0.3827	124	0.6112	0.3510	0.6112	0.7818
No log	0.3889	126	0.6293	0.3189	0.6293	0.7933
No log	0.3951	128	0.6176	0.3245	0.6176	0.7859
No log	0.4012	130	0.6165	0.3299	0.6165	0.7852
No log	0.4074	132	0.6461	0.3023	0.6461	0.8038
No log	0.4136	134	0.6735	0.2875	0.6735	0.8207
No log	0.4198	136	0.6151	0.3099	0.6151	0.7843
No log	0.4259	138	0.5869	0.4048	0.5869	0.7661
No log	0.4321	140	0.5892	0.4399	0.5892	0.7676
No log	0.4383	142	0.5836	0.3929	0.5836	0.7639
No log	0.4444	144	0.6128	0.3424	0.6128	0.7828
No log	0.4506	146	0.6613	0.3114	0.6613	0.8132
No log	0.4568	148	0.6239	0.3631	0.6239	0.7899
No log	0.4630	150	0.5961	0.3952	0.5961	0.7721
No log	0.4691	152	0.6285	0.4095	0.6285	0.7928
No log	0.4753	154	0.6618	0.4036	0.6618	0.8135
No log	0.4815	156	0.7177	0.3995	0.7177	0.8472
No log	0.4877	158	0.6363	0.3973	0.6363	0.7977
No log	0.4938	160	0.6613	0.4098	0.6613	0.8132
No log	0.5	162	0.6635	0.3996	0.6635	0.8146
No log	0.5062	164	0.7016	0.4561	0.7016	0.8376
No log	0.5123	166	1.0083	0.3563	1.0083	1.0041
No log	0.5185	168	0.9165	0.3809	0.9165	0.9574
No log	0.5247	170	0.6437	0.4354	0.6437	0.8023
No log	0.5309	172	0.6412	0.3683	0.6412	0.8008
No log	0.5370	174	0.5992	0.4052	0.5992	0.7741
No log	0.5432	176	0.7205	0.2546	0.7205	0.8488
No log	0.5494	178	0.7165	0.2393	0.7165	0.8465
No log	0.5556	180	0.7035	0.2393	0.7035	0.8388
No log	0.5617	182	0.6571	0.3441	0.6571	0.8106
No log	0.5679	184	0.6337	0.3977	0.6337	0.7961
No log	0.5741	186	0.5949	0.3892	0.5949	0.7713
No log	0.5802	188	0.5644	0.4038	0.5644	0.7513
No log	0.5864	190	0.5696	0.4014	0.5696	0.7547
No log	0.5926	192	0.5162	0.5154	0.5162	0.7184
No log	0.5988	194	0.6681	0.4977	0.6681	0.8174
No log	0.6049	196	0.7036	0.5012	0.7036	0.8388
No log	0.6111	198	0.5028	0.6061	0.5028	0.7091
No log	0.6173	200	0.5205	0.6321	0.5205	0.7215
No log	0.6235	202	0.5416	0.6280	0.5416	0.7359
No log	0.6296	204	0.5649	0.6276	0.5649	0.7516
No log	0.6358	206	0.5923	0.6014	0.5923	0.7696
No log	0.6420	208	0.6127	0.6006	0.6127	0.7828
No log	0.6481	210	0.6245	0.5568	0.6245	0.7903
No log	0.6543	212	0.5958	0.5561	0.5958	0.7719
No log	0.6605	214	0.6487	0.4880	0.6487	0.8054
No log	0.6667	216	0.5837	0.5205	0.5837	0.7640
No log	0.6728	218	0.6123	0.5419	0.6123	0.7825
No log	0.6790	220	0.5611	0.5287	0.5611	0.7491
No log	0.6852	222	0.6356	0.4920	0.6356	0.7973
No log	0.6914	224	0.5574	0.4975	0.5574	0.7466
No log	0.6975	226	0.6543	0.5386	0.6543	0.8089
No log	0.7037	228	0.8776	0.4665	0.8776	0.9368
No log	0.7099	230	0.7915	0.4952	0.7915	0.8897
No log	0.7160	232	0.5480	0.5974	0.5480	0.7403
No log	0.7222	234	0.5939	0.5282	0.5939	0.7706
No log	0.7284	236	0.6206	0.5357	0.6206	0.7878
No log	0.7346	238	0.5237	0.5734	0.5237	0.7237
No log	0.7407	240	0.7214	0.5059	0.7214	0.8493
No log	0.7469	242	0.8596	0.4655	0.8596	0.9272
No log	0.7531	244	0.6007	0.5625	0.6007	0.7751
No log	0.7593	246	0.5881	0.5199	0.5881	0.7669
No log	0.7654	248	0.7176	0.4967	0.7176	0.8471
No log	0.7716	250	0.5771	0.5389	0.5771	0.7597
No log	0.7778	252	0.6495	0.5487	0.6495	0.8059
No log	0.7840	254	0.8531	0.4780	0.8531	0.9236
No log	0.7901	256	0.6940	0.5208	0.6940	0.8331
No log	0.7963	258	0.5827	0.5236	0.5827	0.7634
No log	0.8025	260	0.7156	0.4965	0.7156	0.8459
No log	0.8086	262	0.5985	0.5086	0.5985	0.7736
No log	0.8148	264	0.5863	0.5661	0.5863	0.7657
No log	0.8210	266	0.5809	0.5579	0.5809	0.7622
No log	0.8272	268	0.5713	0.5620	0.5713	0.7559
No log	0.8333	270	0.7088	0.5050	0.7088	0.8419
No log	0.8395	272	0.6551	0.5399	0.6551	0.8094
No log	0.8457	274	0.5431	0.5988	0.5431	0.7369
No log	0.8519	276	0.7554	0.5056	0.7554	0.8691
No log	0.8580	278	0.7896	0.4943	0.7896	0.8886
No log	0.8642	280	0.5659	0.5750	0.5659	0.7523
No log	0.8704	282	0.5282	0.5411	0.5282	0.7268
No log	0.8765	284	0.5291	0.5608	0.5291	0.7274
No log	0.8827	286	0.5657	0.5858	0.5657	0.7522
No log	0.8889	288	0.7988	0.4672	0.7988	0.8938
No log	0.8951	290	0.7681	0.4812	0.7681	0.8764
No log	0.9012	292	0.5641	0.5866	0.5641	0.7511
No log	0.9074	294	0.5359	0.5458	0.5359	0.7320
No log	0.9136	296	0.5431	0.5575	0.5431	0.7369
No log	0.9198	298	0.5540	0.6075	0.5540	0.7443
No log	0.9259	300	0.5986	0.6136	0.5986	0.7737
No log	0.9321	302	0.5678	0.6056	0.5678	0.7535
No log	0.9383	304	0.5515	0.6348	0.5515	0.7426
No log	0.9444	306	0.5740	0.6308	0.5740	0.7576
No log	0.9506	308	0.6040	0.6268	0.6040	0.7771
No log	0.9568	310	0.6122	0.6286	0.6122	0.7824
No log	0.9630	312	0.6156	0.6265	0.6156	0.7846
No log	0.9691	314	0.6067	0.6080	0.6067	0.7789
No log	0.9753	316	0.5722	0.6045	0.5722	0.7564
No log	0.9815	318	0.5903	0.5957	0.5903	0.7683
No log	0.9877	320	0.5750	0.5945	0.5750	0.7583
No log	0.9938	322	0.6512	0.5827	0.6512	0.8070
No log	1.0	324	0.9320	0.4843	0.9320	0.9654
No log	1.0062	326	0.8251	0.5509	0.8251	0.9084
No log	1.0123	328	0.5694	0.6138	0.5694	0.7546
No log	1.0185	330	0.6148	0.6215	0.6148	0.7841
No log	1.0247	332	0.5822	0.6295	0.5822	0.7630
No log	1.0309	334	0.8952	0.5388	0.8952	0.9461
No log	1.0370	336	1.0885	0.4603	1.0885	1.0433
No log	1.0432	338	0.8350	0.5222	0.8350	0.9138
No log	1.0494	340	0.5274	0.6369	0.5274	0.7262
No log	1.0556	342	0.7186	0.5365	0.7186	0.8477
No log	1.0617	344	0.7991	0.4888	0.7991	0.8939
No log	1.0679	346	0.5893	0.5864	0.5893	0.7677
No log	1.0741	348	0.5150	0.6151	0.5150	0.7177
No log	1.0802	350	0.5539	0.6062	0.5539	0.7442
No log	1.0864	352	0.5915	0.5974	0.5915	0.7691
No log	1.0926	354	0.5506	0.6085	0.5506	0.7420
No log	1.0988	356	0.5709	0.5994	0.5709	0.7556
No log	1.1049	358	0.5781	0.5981	0.5781	0.7603
No log	1.1111	360	0.6460	0.5824	0.6460	0.8038
No log	1.1173	362	0.6267	0.5981	0.6267	0.7917
No log	1.1235	364	0.5274	0.6282	0.5274	0.7263
No log	1.1296	366	0.5221	0.6434	0.5221	0.7226
No log	1.1358	368	0.5297	0.6321	0.5297	0.7278
No log	1.1420	370	0.7674	0.5393	0.7674	0.8760
No log	1.1481	372	0.8930	0.4883	0.8930	0.9450
No log	1.1543	374	0.6731	0.5585	0.6731	0.8205
No log	1.1605	376	0.5085	0.6152	0.5085	0.7131
No log	1.1667	378	0.4981	0.6073	0.4981	0.7058
No log	1.1728	380	0.4983	0.5914	0.4983	0.7059
No log	1.1790	382	0.5494	0.6079	0.5494	0.7412
No log	1.1852	384	0.6033	0.5655	0.6033	0.7767
No log	1.1914	386	0.5141	0.6098	0.5141	0.7170
No log	1.1975	388	0.4988	0.5866	0.4988	0.7063
No log	1.2037	390	0.5442	0.6062	0.5442	0.7377
No log	1.2099	392	0.5422	0.6193	0.5422	0.7363
No log	1.2160	394	0.5565	0.6161	0.5565	0.7460
No log	1.2222	396	0.5775	0.6102	0.5775	0.7599
No log	1.2284	398	0.6056	0.5902	0.6056	0.7782
No log	1.2346	400	0.6930	0.5809	0.6930	0.8325
No log	1.2407	402	0.6343	0.5911	0.6343	0.7964
No log	1.2469	404	0.5288	0.5978	0.5288	0.7272
No log	1.2531	406	0.5705	0.5752	0.5705	0.7553
No log	1.2593	408	0.5883	0.5624	0.5883	0.7670
No log	1.2654	410	0.5037	0.6157	0.5037	0.7097
No log	1.2716	412	0.5042	0.6066	0.5042	0.7101
No log	1.2778	414	0.5187	0.6075	0.5187	0.7202
No log	1.2840	416	0.5175	0.6117	0.5175	0.7194
No log	1.2901	418	0.5315	0.6356	0.5315	0.7290
No log	1.2963	420	0.5280	0.6298	0.5280	0.7266
No log	1.3025	422	0.5397	0.6395	0.5397	0.7347
No log	1.3086	424	0.5862	0.6225	0.5862	0.7656
No log	1.3148	426	0.5332	0.6210	0.5332	0.7302
No log	1.3210	428	0.5415	0.6133	0.5415	0.7359
No log	1.3272	430	0.6526	0.5947	0.6526	0.8078
No log	1.3333	432	0.7754	0.5267	0.7754	0.8806
No log	1.3395	434	0.6017	0.5771	0.6017	0.7757
No log	1.3457	436	0.5507	0.5767	0.5507	0.7421
No log	1.3519	438	0.5592	0.5611	0.5592	0.7478
No log	1.3580	440	0.6935	0.5673	0.6935	0.8327
No log	1.3642	442	0.8073	0.5455	0.8073	0.8985
No log	1.3704	444	0.7344	0.5640	0.7344	0.8570
No log	1.3765	446	0.6640	0.5735	0.6640	0.8148
No log	1.3827	448	0.6213	0.5643	0.6213	0.7882
No log	1.3889	450	0.6734	0.5616	0.6734	0.8206
No log	1.3951	452	0.7620	0.5317	0.7620	0.8729
No log	1.4012	454	0.7316	0.5472	0.7316	0.8554
No log	1.4074	456	0.5847	0.5641	0.5847	0.7647
No log	1.4136	458	0.5829	0.5645	0.5829	0.7635
No log	1.4198	460	0.5851	0.5521	0.5851	0.7649
No log	1.4259	462	0.7493	0.5256	0.7493	0.8656
No log	1.4321	464	0.6618	0.5475	0.6618	0.8135
No log	1.4383	466	0.5160	0.6019	0.5160	0.7184
No log	1.4444	468	0.6155	0.5304	0.6155	0.7846
No log	1.4506	470	0.5964	0.5422	0.5964	0.7723
No log	1.4568	472	0.5140	0.6146	0.5140	0.7169
No log	1.4630	474	0.6116	0.5885	0.6116	0.7821
No log	1.4691	476	0.6242	0.5801	0.6242	0.7900
No log	1.4753	478	0.5701	0.6076	0.5701	0.7551
No log	1.4815	480	0.6248	0.5808	0.6248	0.7905
No log	1.4877	482	0.6575	0.5580	0.6575	0.8109
No log	1.4938	484	0.6346	0.5770	0.6346	0.7966
No log	1.5	486	0.5532	0.5979	0.5532	0.7438
No log	1.5062	488	0.5434	0.5907	0.5434	0.7372
No log	1.5123	490	0.5362	0.5873	0.5362	0.7323
No log	1.5185	492	0.6328	0.5869	0.6328	0.7955
No log	1.5247	494	0.8573	0.5082	0.8573	0.9259
No log	1.5309	496	0.8415	0.5124	0.8415	0.9173
No log	1.5370	498	0.6116	0.6099	0.6116	0.7820
1.0908	1.5432	500	0.5312	0.5964	0.5312	0.7288
1.0908	1.5494	502	0.5435	0.5852	0.5435	0.7373
1.0908	1.5556	504	0.5326	0.6194	0.5326	0.7298
1.0908	1.5617	506	0.6002	0.6174	0.6002	0.7747
1.0908	1.5679	508	0.5677	0.6242	0.5677	0.7535
1.0908	1.5741	510	0.5465	0.6153	0.5465	0.7393
1.0908	1.5802	512	0.5839	0.6189	0.5839	0.7641
1.0908	1.5864	514	0.6221	0.6059	0.6221	0.7887
1.0908	1.5926	516	0.5793	0.6119	0.5793	0.7611
1.0908	1.5988	518	0.5266	0.6109	0.5266	0.7257
1.0908	1.6049	520	0.5465	0.6000	0.5465	0.7393
1.0908	1.6111	522	0.6881	0.5671	0.6881	0.8295
1.0908	1.6173	524	0.7589	0.5319	0.7589	0.8712
1.0908	1.6235	526	0.6694	0.5688	0.6694	0.8181
1.0908	1.6296	528	0.6377	0.5682	0.6377	0.7985
1.0908	1.6358	530	0.5750	0.6054	0.5750	0.7583
1.0908	1.6420	532	0.5559	0.5998	0.5559	0.7456
1.0908	1.6481	534	0.5652	0.5985	0.5652	0.7518
1.0908	1.6543	536	0.6196	0.5765	0.6196	0.7871
1.0908	1.6605	538	0.6053	0.5934	0.6053	0.7780
1.0908	1.6667	540	0.5899	0.5904	0.5899	0.7681
1.0908	1.6728	542	0.6482	0.5716	0.6482	0.8051
1.0908	1.6790	544	0.5883	0.6085	0.5883	0.7670
1.0908	1.6852	546	0.5591	0.5830	0.5591	0.7477
1.0908	1.6914	548	0.5792	0.5885	0.5792	0.7611
1.0908	1.6975	550	0.5621	0.5799	0.5621	0.7498
1.0908	1.7037	552	0.5940	0.5779	0.5940	0.7707
1.0908	1.7099	554	0.6595	0.5541	0.6595	0.8121

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1