ASAP_FineTuningBERT_AugV3_k5_task1_organization_fold0

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7078
• Qwk: 0.1258
• Mse: 0.7078
• Rmse: 0.8413

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0034	2	9.7931	0.0	9.7931	3.1294
No log	0.0068	4	8.3739	0.0084	8.3739	2.8938
No log	0.0102	6	7.3017	0.0054	7.3017	2.7022
No log	0.0137	8	6.5930	0.0018	6.5930	2.5677
No log	0.0171	10	5.8640	0.0	5.8640	2.4216
No log	0.0205	12	5.0860	0.0	5.0860	2.2552
No log	0.0239	14	4.2861	0.0	4.2861	2.0703
No log	0.0273	16	3.5391	0.0170	3.5391	1.8812
No log	0.0307	18	2.8712	0.0115	2.8712	1.6945
No log	0.0341	20	2.4228	0.0077	2.4228	1.5565
No log	0.0375	22	1.9433	0.0077	1.9433	1.3940
No log	0.0410	24	1.6710	0.0039	1.6710	1.2927
No log	0.0444	26	1.6108	0.0039	1.6108	1.2692
No log	0.0478	28	1.6069	0.0039	1.6069	1.2676
No log	0.0512	30	1.5458	0.0017	1.5458	1.2433
No log	0.0546	32	1.6646	0.0	1.6646	1.2902
No log	0.0580	34	1.6960	0.0	1.6960	1.3023
No log	0.0614	36	1.9321	0.0	1.9321	1.3900
No log	0.0648	38	1.9377	0.0	1.9377	1.3920
No log	0.0683	40	2.0945	0.0	2.0945	1.4472
No log	0.0717	42	2.2600	0.0	2.2600	1.5033
No log	0.0751	44	2.0413	0.0	2.0413	1.4288
No log	0.0785	46	1.8191	0.0	1.8191	1.3487
No log	0.0819	48	1.6205	0.0056	1.6205	1.2730
No log	0.0853	50	1.7339	0.0073	1.7339	1.3168
No log	0.0887	52	2.4416	0.0039	2.4416	1.5625
No log	0.0922	54	2.5573	0.0039	2.5573	1.5992
No log	0.0956	56	1.7058	0.0141	1.7058	1.3061
No log	0.0990	58	1.5551	0.0203	1.5551	1.2471
No log	0.1024	60	1.4710	0.0059	1.4710	1.2129
No log	0.1058	62	1.4964	0.0184	1.4964	1.2233
No log	0.1092	64	1.8011	0.0	1.8011	1.3420
No log	0.1126	66	2.4439	0.0039	2.4439	1.5633
No log	0.1160	68	2.3024	0.0	2.3024	1.5174
No log	0.1195	70	1.8138	0.0	1.8138	1.3468
No log	0.1229	72	1.4916	0.0111	1.4916	1.2213
No log	0.1263	74	1.4889	0.0145	1.4889	1.2202
No log	0.1297	76	1.5472	0.0	1.5472	1.2439
No log	0.1331	78	1.6364	0.0	1.6364	1.2792
No log	0.1365	80	1.6745	0.0	1.6745	1.2940
No log	0.1399	82	1.6902	0.0	1.6902	1.3001
No log	0.1433	84	1.6397	0.0	1.6397	1.2805
No log	0.1468	86	1.5460	0.0	1.5460	1.2434
No log	0.1502	88	1.5361	-0.0008	1.5361	1.2394
No log	0.1536	90	1.6197	0.0	1.6197	1.2727
No log	0.1570	92	1.6757	0.0	1.6757	1.2945
No log	0.1604	94	1.6303	-0.0025	1.6303	1.2768
No log	0.1638	96	1.4694	0.0174	1.4694	1.2122
No log	0.1672	98	1.4304	0.0820	1.4304	1.1960
No log	0.1706	100	1.4169	0.0789	1.4169	1.1903
No log	0.1741	102	1.3217	0.0857	1.3217	1.1497
No log	0.1775	104	1.2178	0.0746	1.2178	1.1035
No log	0.1809	106	1.2079	0.0642	1.2079	1.0990
No log	0.1843	108	1.2822	0.0538	1.2822	1.1324
No log	0.1877	110	1.2908	0.0898	1.2908	1.1362
No log	0.1911	112	1.1107	0.0746	1.1107	1.0539
No log	0.1945	114	1.0908	0.0746	1.0908	1.0444
No log	0.1980	116	1.0754	0.0746	1.0754	1.0370
No log	0.2014	118	1.1033	0.0701	1.1033	1.0504
No log	0.2048	120	1.1628	0.0673	1.1628	1.0783
No log	0.2082	122	1.2853	0.0478	1.2853	1.1337
No log	0.2116	124	1.5552	0.0009	1.5552	1.2471
No log	0.2150	126	1.4928	0.0119	1.4928	1.2218
No log	0.2184	128	1.3572	0.0389	1.3572	1.1650
No log	0.2218	130	1.2453	0.0777	1.2453	1.1159
No log	0.2253	132	1.1849	0.0761	1.1849	1.0885
No log	0.2287	134	1.1638	0.0714	1.1638	1.0788
No log	0.2321	136	1.1260	0.0701	1.1260	1.0611
No log	0.2355	138	1.0749	0.0746	1.0749	1.0368
No log	0.2389	140	1.0194	0.0746	1.0194	1.0097
No log	0.2423	142	0.9818	0.0746	0.9818	0.9909
No log	0.2457	144	0.8923	0.0746	0.8923	0.9446
No log	0.2491	146	0.8705	0.0746	0.8705	0.9330
No log	0.2526	148	0.8852	0.0746	0.8852	0.9409
No log	0.2560	150	0.9269	0.0746	0.9269	0.9628
No log	0.2594	152	0.9304	0.0746	0.9304	0.9646
No log	0.2628	154	0.9376	0.0722	0.9376	0.9683
No log	0.2662	156	0.8727	0.0692	0.8727	0.9342
No log	0.2696	158	0.8580	0.0731	0.8580	0.9263
No log	0.2730	160	0.8480	0.0746	0.8480	0.9209
No log	0.2765	162	0.8519	0.0746	0.8519	0.9230
No log	0.2799	164	0.8474	0.0746	0.8474	0.9205
No log	0.2833	166	0.8066	0.0746	0.8066	0.8981
No log	0.2867	168	0.7839	0.0746	0.7839	0.8854
No log	0.2901	170	0.7992	0.0698	0.7992	0.8940
No log	0.2935	172	0.8714	0.0590	0.8714	0.9335
No log	0.2969	174	0.9421	0.0436	0.9421	0.9706
No log	0.3003	176	0.9884	0.0426	0.9884	0.9942
No log	0.3038	178	0.9998	0.0709	0.9998	0.9999
No log	0.3072	180	1.0845	0.0701	1.0845	1.0414
No log	0.3106	182	1.0985	0.0738	1.0985	1.0481
No log	0.3140	184	0.9863	0.0701	0.9863	0.9931
No log	0.3174	186	0.9160	0.0701	0.9160	0.9571
No log	0.3208	188	0.8362	0.0746	0.8362	0.9145
No log	0.3242	190	0.8068	0.0746	0.8068	0.8982
No log	0.3276	192	0.8043	0.0746	0.8043	0.8968
No log	0.3311	194	0.8077	0.0746	0.8077	0.8987
No log	0.3345	196	0.8304	0.0746	0.8304	0.9113
No log	0.3379	198	0.8938	0.0853	0.8938	0.9454
No log	0.3413	200	0.9282	0.0898	0.9282	0.9634
No log	0.3447	202	0.9600	0.0898	0.9600	0.9798
No log	0.3481	204	0.9534	0.0831	0.9534	0.9764
No log	0.3515	206	0.9297	0.0770	0.9297	0.9642
No log	0.3549	208	0.8803	0.0746	0.8803	0.9382
No log	0.3584	210	0.8667	0.0746	0.8667	0.9310
No log	0.3618	212	0.8477	0.0746	0.8477	0.9207
No log	0.3652	214	0.7882	0.0746	0.7882	0.8878
No log	0.3686	216	0.7579	0.0746	0.7579	0.8706
No log	0.3720	218	0.7602	0.0746	0.7602	0.8719
No log	0.3754	220	0.7729	0.0746	0.7729	0.8791
No log	0.3788	222	0.7864	0.0746	0.7864	0.8868
No log	0.3823	224	0.8020	0.0746	0.8020	0.8956
No log	0.3857	226	0.8006	0.0746	0.8006	0.8948
No log	0.3891	228	0.7909	0.0746	0.7909	0.8894
No log	0.3925	230	0.7843	0.0746	0.7843	0.8856
No log	0.3959	232	0.7779	0.0746	0.7779	0.8820
No log	0.3993	234	0.7644	0.0667	0.7644	0.8743
No log	0.4027	236	0.7592	0.0642	0.7592	0.8713
No log	0.4061	238	0.7650	0.0642	0.7650	0.8746
No log	0.4096	240	0.7682	0.0642	0.7682	0.8765
No log	0.4130	242	0.7682	0.0810	0.7682	0.8765
No log	0.4164	244	0.7812	0.3335	0.7812	0.8838
No log	0.4198	246	0.7869	0.2991	0.7869	0.8871
No log	0.4232	248	0.7713	0.3375	0.7713	0.8782
No log	0.4266	250	0.7662	0.3564	0.7662	0.8753
No log	0.4300	252	0.7565	0.3929	0.7565	0.8698
No log	0.4334	254	0.7445	0.3994	0.7445	0.8629
No log	0.4369	256	0.7331	0.0731	0.7331	0.8562
No log	0.4403	258	0.7337	0.0746	0.7337	0.8566
No log	0.4437	260	0.7405	0.0746	0.7405	0.8605
No log	0.4471	262	0.7423	0.0746	0.7423	0.8616
No log	0.4505	264	0.7450	0.2266	0.7450	0.8632
No log	0.4539	266	0.7730	0.3198	0.7730	0.8792
No log	0.4573	268	0.8060	0.2856	0.8060	0.8978
No log	0.4608	270	0.8206	0.2671	0.8206	0.9059
No log	0.4642	272	0.8178	0.2638	0.8178	0.9043
No log	0.4676	274	0.7916	0.2677	0.7916	0.8897
No log	0.4710	276	0.7721	0.0712	0.7721	0.8787
No log	0.4744	278	0.7712	0.0534	0.7712	0.8782
No log	0.4778	280	0.7698	0.0570	0.7698	0.8774
No log	0.4812	282	0.7787	0.2548	0.7787	0.8824
No log	0.4846	284	0.7993	0.2875	0.7993	0.8940
No log	0.4881	286	0.7894	0.2345	0.7894	0.8885
No log	0.4915	288	0.7813	0.2293	0.7813	0.8839
No log	0.4949	290	0.7745	0.2461	0.7745	0.8801
No log	0.4983	292	0.7631	0.1031	0.7631	0.8736
No log	0.5017	294	0.7791	0.0590	0.7791	0.8827
No log	0.5051	296	0.8673	0.0399	0.8673	0.9313
No log	0.5085	298	0.8269	0.0399	0.8269	0.9093
No log	0.5119	300	0.7860	0.0463	0.7860	0.8866
No log	0.5154	302	0.7538	0.1142	0.7538	0.8682
No log	0.5188	304	0.7570	0.2593	0.7570	0.8701
No log	0.5222	306	0.7798	0.3413	0.7798	0.8831
No log	0.5256	308	0.8132	0.2810	0.8132	0.9018
No log	0.5290	310	0.8275	0.2406	0.8275	0.9097
No log	0.5324	312	0.8360	0.2488	0.8360	0.9143
No log	0.5358	314	0.8473	0.2454	0.8473	0.9205
No log	0.5392	316	0.8522	0.2351	0.8522	0.9232
No log	0.5427	318	0.8386	0.2462	0.8386	0.9157
No log	0.5461	320	0.8322	0.2458	0.8322	0.9123
No log	0.5495	322	0.8457	0.2527	0.8457	0.9196
No log	0.5529	324	0.8278	0.2566	0.8278	0.9098
No log	0.5563	326	0.7908	0.2929	0.7908	0.8893
No log	0.5597	328	0.7614	0.3200	0.7614	0.8726
No log	0.5631	330	0.7395	0.3583	0.7395	0.8599
No log	0.5666	332	0.6990	0.3874	0.6990	0.8361
No log	0.5700	334	0.6702	0.2064	0.6702	0.8186
No log	0.5734	336	0.6963	0.1017	0.6963	0.8344
No log	0.5768	338	0.6813	0.1154	0.6813	0.8254
No log	0.5802	340	0.6738	0.1075	0.6738	0.8208
No log	0.5836	342	0.7152	0.0883	0.7152	0.8457
No log	0.5870	344	0.8029	0.0951	0.8029	0.8960
No log	0.5904	346	0.8764	0.1199	0.8764	0.9362
No log	0.5939	348	0.8574	0.1147	0.8574	0.9259
No log	0.5973	350	0.7871	0.1369	0.7871	0.8872
No log	0.6007	352	0.6960	0.1937	0.6960	0.8343
No log	0.6041	354	0.6868	0.2177	0.6868	0.8287
No log	0.6075	356	0.7183	0.2021	0.7183	0.8475
No log	0.6109	358	0.7073	0.2081	0.7073	0.8410
No log	0.6143	360	0.6950	0.2734	0.6950	0.8337
No log	0.6177	362	0.6845	0.3730	0.6845	0.8274
No log	0.6212	364	0.7018	0.3911	0.7018	0.8377
No log	0.6246	366	0.7061	0.3730	0.7061	0.8403
No log	0.6280	368	0.7112	0.3712	0.7112	0.8433
No log	0.6314	370	0.7372	0.3157	0.7372	0.8586
No log	0.6348	372	0.7454	0.3308	0.7454	0.8633
No log	0.6382	374	0.7118	0.2662	0.7118	0.8437
No log	0.6416	376	0.7166	0.0805	0.7166	0.8466
No log	0.6451	378	0.7729	0.0805	0.7729	0.8792
No log	0.6485	380	0.8465	0.0805	0.8465	0.9201
No log	0.6519	382	0.7298	0.0805	0.7298	0.8543
No log	0.6553	384	0.6721	0.1003	0.6721	0.8198
No log	0.6587	386	0.6624	0.3902	0.6624	0.8139
No log	0.6621	388	0.6726	0.4163	0.6726	0.8201
No log	0.6655	390	0.6805	0.3943	0.6805	0.8249
No log	0.6689	392	0.6852	0.3974	0.6852	0.8278
No log	0.6724	394	0.6922	0.3972	0.6922	0.8320
No log	0.6758	396	0.7127	0.3837	0.7127	0.8442
No log	0.6792	398	0.7308	0.3600	0.7308	0.8549
No log	0.6826	400	0.7254	0.3731	0.7254	0.8517
No log	0.6860	402	0.7059	0.3821	0.7059	0.8402
No log	0.6894	404	0.6868	0.3973	0.6868	0.8287
No log	0.6928	406	0.6798	0.3789	0.6798	0.8245
No log	0.6962	408	0.6626	0.3416	0.6626	0.8140
No log	0.6997	410	0.6572	0.2208	0.6572	0.8107
No log	0.7031	412	0.6454	0.2157	0.6454	0.8034
No log	0.7065	414	0.6285	0.3623	0.6285	0.7928
No log	0.7099	416	0.6453	0.4245	0.6453	0.8033
No log	0.7133	418	0.6675	0.3870	0.6675	0.8170
No log	0.7167	420	0.6677	0.3934	0.6677	0.8171
No log	0.7201	422	0.6465	0.4168	0.6465	0.8040
No log	0.7235	424	0.6170	0.4429	0.6170	0.7855
No log	0.7270	426	0.6011	0.3656	0.6011	0.7753
No log	0.7304	428	0.6234	0.2674	0.6234	0.7896
No log	0.7338	430	0.6360	0.2458	0.6360	0.7975
No log	0.7372	432	0.6091	0.3489	0.6091	0.7805
No log	0.7406	434	0.6307	0.4244	0.6307	0.7942
No log	0.7440	436	0.6842	0.3997	0.6842	0.8272
No log	0.7474	438	0.6890	0.3966	0.6890	0.8300
No log	0.7509	440	0.6663	0.4180	0.6663	0.8163
No log	0.7543	442	0.6438	0.4168	0.6438	0.8024
No log	0.7577	444	0.6353	0.4213	0.6353	0.7970
No log	0.7611	446	0.6444	0.4149	0.6444	0.8027
No log	0.7645	448	0.6398	0.4108	0.6398	0.7998
No log	0.7679	450	0.6347	0.4234	0.6347	0.7967
No log	0.7713	452	0.6147	0.4391	0.6147	0.7840
No log	0.7747	454	0.6097	0.4571	0.6097	0.7808
No log	0.7782	456	0.6123	0.4487	0.6123	0.7825
No log	0.7816	458	0.6244	0.3393	0.6244	0.7902
No log	0.7850	460	0.7474	0.2516	0.7474	0.8645
No log	0.7884	462	0.7379	0.2420	0.7379	0.8590
No log	0.7918	464	0.6979	0.2462	0.6979	0.8354
No log	0.7952	466	0.6523	0.2734	0.6523	0.8077
No log	0.7986	468	0.5904	0.3358	0.5904	0.7684
No log	0.8020	470	0.5644	0.4563	0.5644	0.7513
No log	0.8055	472	0.5960	0.4543	0.5960	0.7720
No log	0.8089	474	0.6467	0.4355	0.6467	0.8042
No log	0.8123	476	0.7100	0.4001	0.7100	0.8426
No log	0.8157	478	0.7401	0.3832	0.7401	0.8603
No log	0.8191	480	0.7332	0.3778	0.7332	0.8562
No log	0.8225	482	0.7194	0.3829	0.7194	0.8482
No log	0.8259	484	0.7362	0.3803	0.7362	0.8580
No log	0.8294	486	0.7871	0.3303	0.7871	0.8872
No log	0.8328	488	0.8049	0.3452	0.8049	0.8972
No log	0.8362	490	0.7350	0.3653	0.7350	0.8573
No log	0.8396	492	0.6462	0.4639	0.6462	0.8039
No log	0.8430	494	0.5988	0.4858	0.5988	0.7738
No log	0.8464	496	0.5610	0.4990	0.5610	0.7490
No log	0.8498	498	0.5571	0.3702	0.5571	0.7464
1.4524	0.8532	500	0.6092	0.1768	0.6092	0.7805
1.4524	0.8567	502	0.6134	0.1951	0.6134	0.7832
1.4524	0.8601	504	0.5623	0.3601	0.5623	0.7498
1.4524	0.8635	506	0.5490	0.4763	0.5490	0.7410
1.4524	0.8669	508	0.5503	0.5154	0.5503	0.7418
1.4524	0.8703	510	0.5798	0.5059	0.5798	0.7615
1.4524	0.8737	512	0.6018	0.4905	0.6018	0.7757
1.4524	0.8771	514	0.6010	0.4995	0.6010	0.7752
1.4524	0.8805	516	0.5949	0.4992	0.5949	0.7713
1.4524	0.8840	518	0.5854	0.3920	0.5854	0.7651
1.4524	0.8874	520	0.6002	0.1498	0.6002	0.7747
1.4524	0.8908	522	0.6338	0.1328	0.6338	0.7961
1.4524	0.8942	524	0.6676	0.1419	0.6676	0.8171
1.4524	0.8976	526	0.6936	0.1419	0.6936	0.8328
1.4524	0.9010	528	0.7078	0.1258	0.7078	0.8413

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1