ASAP_FineTuningBERT_Aug_k40_task1_organization_fold3

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5940
• Qwk: 0.4474
• Mse: 0.5940
• Rmse: 0.7707

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0033	2	9.8280	0.0	9.8280	3.1350
No log	0.0065	4	7.8842	0.0162	7.8842	2.8079
No log	0.0098	6	6.3990	0.0	6.3990	2.5296
No log	0.0130	8	5.1852	0.0	5.1852	2.2771
No log	0.0163	10	4.2356	0.0054	4.2356	2.0581
No log	0.0195	12	3.2394	0.0137	3.2394	1.7998
No log	0.0228	14	2.4587	0.0038	2.4587	1.5680
No log	0.0260	16	1.8517	0.0	1.8517	1.3608
No log	0.0293	18	1.4080	0.1486	1.4080	1.1866
No log	0.0325	20	1.1413	0.0417	1.1413	1.0683
No log	0.0358	22	0.9955	0.0202	0.9955	0.9977
No log	0.0390	24	0.8537	0.0202	0.8537	0.9240
No log	0.0423	26	0.8631	0.0102	0.8631	0.9291
No log	0.0455	28	0.9577	0.0202	0.9577	0.9786
No log	0.0488	30	0.9609	0.0202	0.9609	0.9802
No log	0.0520	32	0.8735	0.0	0.8735	0.9346
No log	0.0553	34	0.9323	0.0	0.9323	0.9656
No log	0.0585	36	1.5750	-0.0838	1.5750	1.2550
No log	0.0618	38	1.6720	-0.0896	1.6720	1.2930
No log	0.0650	40	0.9956	0.0	0.9956	0.9978
No log	0.0683	42	0.9443	0.0	0.9443	0.9717
No log	0.0715	44	0.9934	0.0	0.9934	0.9967
No log	0.0748	46	0.9798	0.0	0.9798	0.9899
No log	0.0780	48	0.9180	0.0	0.9180	0.9581
No log	0.0813	50	0.9063	0.0	0.9063	0.9520
No log	0.0846	52	0.9290	0.0	0.9290	0.9638
No log	0.0878	54	0.9408	0.0	0.9408	0.9699
No log	0.0911	56	0.9915	0.0	0.9915	0.9957
No log	0.0943	58	1.0125	0.0	1.0125	1.0062
No log	0.0976	60	0.9510	0.0	0.9510	0.9752
No log	0.1008	62	0.9077	0.0	0.9077	0.9527
No log	0.1041	64	0.8984	0.0	0.8984	0.9478
No log	0.1073	66	0.9036	0.0	0.9036	0.9506
No log	0.1106	68	0.9302	0.0	0.9302	0.9644
No log	0.1138	70	0.9921	0.0	0.9921	0.9960
No log	0.1171	72	1.0047	0.0	1.0047	1.0023
No log	0.1203	74	0.9407	0.0	0.9407	0.9699
No log	0.1236	76	0.9206	0.0	0.9206	0.9595
No log	0.1268	78	0.8918	0.0	0.8918	0.9443
No log	0.1301	80	0.8687	0.0	0.8687	0.9321
No log	0.1333	82	0.8286	0.0	0.8286	0.9103
No log	0.1366	84	0.8069	0.0	0.8069	0.8983
No log	0.1398	86	0.8319	0.0102	0.8319	0.9121
No log	0.1431	88	0.8142	0.0	0.8142	0.9023
No log	0.1463	90	0.8143	0.0126	0.8143	0.9024
No log	0.1496	92	0.8193	0.0875	0.8193	0.9052
No log	0.1528	94	0.8141	0.0110	0.8141	0.9023
No log	0.1561	96	0.8293	0.0110	0.8293	0.9107
No log	0.1593	98	0.8198	0.0193	0.8198	0.9054
No log	0.1626	100	0.8037	0.1042	0.8037	0.8965
No log	0.1659	102	0.8072	0.0420	0.8072	0.8984
No log	0.1691	104	0.8479	0.0	0.8479	0.9208
No log	0.1724	106	0.8313	0.0	0.8313	0.9117
No log	0.1756	108	0.7926	0.0009	0.7926	0.8903
No log	0.1789	110	0.7830	0.0174	0.7830	0.8849
No log	0.1821	112	0.7738	0.2286	0.7738	0.8797
No log	0.1854	114	0.7780	0.2790	0.7780	0.8821
No log	0.1886	116	0.7788	0.3083	0.7788	0.8825
No log	0.1919	118	0.7589	0.1116	0.7589	0.8711
No log	0.1951	120	0.7985	0.0082	0.7985	0.8936
No log	0.1984	122	0.7767	0.0174	0.7767	0.8813
No log	0.2016	124	0.7545	0.2514	0.7545	0.8686
No log	0.2049	126	0.7438	0.2783	0.7438	0.8624
No log	0.2081	128	0.7362	0.3006	0.7362	0.8580
No log	0.2114	130	0.7286	0.3182	0.7286	0.8536
No log	0.2146	132	0.7113	0.2678	0.7113	0.8434
No log	0.2179	134	0.7183	0.3581	0.7183	0.8475
No log	0.2211	136	0.7523	0.3696	0.7523	0.8674
No log	0.2244	138	0.6806	0.3442	0.6806	0.8250
No log	0.2276	140	0.6619	0.1762	0.6619	0.8136
No log	0.2309	142	0.6369	0.3063	0.6369	0.7981
No log	0.2341	144	0.6250	0.3667	0.6250	0.7906
No log	0.2374	146	0.6358	0.3852	0.6358	0.7974
No log	0.2407	148	0.6518	0.3988	0.6518	0.8074
No log	0.2439	150	0.6508	0.3825	0.6508	0.8068
No log	0.2472	152	0.6230	0.3369	0.6230	0.7893
No log	0.2504	154	0.6665	0.1868	0.6665	0.8164
No log	0.2537	156	0.6700	0.1648	0.6700	0.8185
No log	0.2569	158	0.6956	0.3505	0.6956	0.8340
No log	0.2602	160	0.7522	0.3653	0.7522	0.8673
No log	0.2634	162	0.7340	0.3449	0.7340	0.8567
No log	0.2667	164	0.7142	0.1175	0.7142	0.8451
No log	0.2699	166	0.7228	0.0789	0.7228	0.8502
No log	0.2732	168	0.7183	0.1939	0.7183	0.8475
No log	0.2764	170	0.7082	0.2445	0.7082	0.8416
No log	0.2797	172	0.7348	0.0567	0.7348	0.8572
No log	0.2829	174	0.7615	0.0339	0.7615	0.8726
No log	0.2862	176	0.7393	0.2047	0.7393	0.8598
No log	0.2894	178	0.7736	0.4271	0.7736	0.8796
No log	0.2927	180	0.7517	0.4483	0.7517	0.8670
No log	0.2959	182	0.6828	0.2631	0.6828	0.8263
No log	0.2992	184	0.6932	0.0910	0.6932	0.8326
No log	0.3024	186	0.6915	0.1173	0.6915	0.8316
No log	0.3057	188	0.6837	0.2426	0.6837	0.8268
No log	0.3089	190	0.6885	0.3003	0.6885	0.8298
No log	0.3122	192	0.7005	0.4008	0.7005	0.8370
No log	0.3154	194	0.7083	0.4157	0.7083	0.8416
No log	0.3187	196	0.6386	0.3240	0.6386	0.7991
No log	0.3220	198	0.6038	0.2881	0.6038	0.7770
No log	0.3252	200	0.5899	0.2995	0.5899	0.7680
No log	0.3285	202	0.5658	0.3379	0.5658	0.7522
No log	0.3317	204	0.6175	0.3986	0.6175	0.7858
No log	0.3350	206	0.7193	0.3634	0.7193	0.8481
No log	0.3382	208	0.5952	0.3381	0.5952	0.7715
No log	0.3415	210	0.6974	0.2492	0.6974	0.8351
No log	0.3447	212	0.6851	0.2279	0.6851	0.8277
No log	0.3480	214	0.6217	0.2676	0.6217	0.7885
No log	0.3512	216	0.9429	0.1617	0.9429	0.9710
No log	0.3545	218	1.2167	0.0248	1.2167	1.1031
No log	0.3577	220	0.8449	0.1254	0.8449	0.9192
No log	0.3610	222	0.7586	0.0184	0.7586	0.8710
No log	0.3642	224	0.7805	0.0202	0.7805	0.8835
No log	0.3675	226	0.7527	0.0202	0.7527	0.8676
No log	0.3707	228	0.7004	0.1163	0.7004	0.8369
No log	0.3740	230	0.6983	0.2532	0.6983	0.8356
No log	0.3772	232	0.7221	0.3849	0.7221	0.8498
No log	0.3805	234	0.7238	0.4289	0.7238	0.8508
No log	0.3837	236	0.6739	0.3213	0.6739	0.8209
No log	0.3870	238	0.6465	0.1658	0.6465	0.8040
No log	0.3902	240	0.6441	0.1929	0.6441	0.8026
No log	0.3935	242	0.6133	0.2772	0.6133	0.7832
No log	0.3967	244	0.6556	0.4135	0.6556	0.8097
No log	0.4	246	0.6654	0.4106	0.6654	0.8157
No log	0.4033	248	0.6343	0.3615	0.6343	0.7964
No log	0.4065	250	0.6444	0.4038	0.6444	0.8027
No log	0.4098	252	0.6834	0.4539	0.6834	0.8267
No log	0.4130	254	0.6738	0.4392	0.6738	0.8208
No log	0.4163	256	0.7183	0.4504	0.7183	0.8475
No log	0.4195	258	0.7256	0.4296	0.7256	0.8518
No log	0.4228	260	0.6494	0.4684	0.6494	0.8058
No log	0.4260	262	0.6734	0.4677	0.6734	0.8206
No log	0.4293	264	0.7009	0.4455	0.7009	0.8372
No log	0.4325	266	0.6233	0.4617	0.6233	0.7895
No log	0.4358	268	0.6101	0.4488	0.6101	0.7811
No log	0.4390	270	0.6498	0.4439	0.6498	0.8061
No log	0.4423	272	0.5969	0.4444	0.5969	0.7726
No log	0.4455	274	0.6119	0.4645	0.6119	0.7823
No log	0.4488	276	0.6208	0.4751	0.6208	0.7879
No log	0.4520	278	0.6315	0.4936	0.6315	0.7947
No log	0.4553	280	0.6343	0.5003	0.6343	0.7964
No log	0.4585	282	0.5705	0.5242	0.5705	0.7553
No log	0.4618	284	0.5711	0.5226	0.5711	0.7557
No log	0.4650	286	0.7045	0.4937	0.7045	0.8393
No log	0.4683	288	0.7194	0.4873	0.7194	0.8482
No log	0.4715	290	0.5407	0.5379	0.5407	0.7353
No log	0.4748	292	0.5240	0.5395	0.5240	0.7238
No log	0.4780	294	0.5589	0.5362	0.5589	0.7476
No log	0.4813	296	0.5896	0.5239	0.5896	0.7678
No log	0.4846	298	0.5465	0.5032	0.5465	0.7392
No log	0.4878	300	0.6332	0.4975	0.6332	0.7957
No log	0.4911	302	0.8441	0.4288	0.8441	0.9188
No log	0.4943	304	0.7489	0.4658	0.7489	0.8654
No log	0.4976	306	0.5632	0.4705	0.5632	0.7504
No log	0.5008	308	0.5908	0.3251	0.5908	0.7686
No log	0.5041	310	0.6097	0.2764	0.6097	0.7808
No log	0.5073	312	0.6635	0.4055	0.6635	0.8146
No log	0.5106	314	0.7223	0.4425	0.7223	0.8499
No log	0.5138	316	0.7923	0.4143	0.7923	0.8901
No log	0.5171	318	0.6973	0.4616	0.6973	0.8351
No log	0.5203	320	0.6106	0.4585	0.6106	0.7814
No log	0.5236	322	0.6431	0.4933	0.6431	0.8020
No log	0.5268	324	0.5937	0.5315	0.5937	0.7705
No log	0.5301	326	0.5311	0.4397	0.5311	0.7288
No log	0.5333	328	0.5357	0.4407	0.5357	0.7319
No log	0.5366	330	0.5930	0.4954	0.5930	0.7700
No log	0.5398	332	0.8120	0.4159	0.8120	0.9011
No log	0.5431	334	0.7952	0.4289	0.7952	0.8917
No log	0.5463	336	0.6250	0.4437	0.6250	0.7906
No log	0.5496	338	0.5842	0.3061	0.5842	0.7643
No log	0.5528	340	0.5999	0.2662	0.5999	0.7745
No log	0.5561	342	0.6019	0.2831	0.6019	0.7758
No log	0.5593	344	0.6488	0.4307	0.6488	0.8055
No log	0.5626	346	0.6943	0.4455	0.6943	0.8332
No log	0.5659	348	0.6549	0.4277	0.6549	0.8093
No log	0.5691	350	0.6053	0.2975	0.6053	0.7780
No log	0.5724	352	0.5965	0.2921	0.5965	0.7724
No log	0.5756	354	0.5803	0.3740	0.5803	0.7618
No log	0.5789	356	0.7094	0.4406	0.7094	0.8423
No log	0.5821	358	0.8661	0.4149	0.8661	0.9307
No log	0.5854	360	0.7912	0.4635	0.7912	0.8895
No log	0.5886	362	0.6034	0.4951	0.6034	0.7768
No log	0.5919	364	0.5371	0.4223	0.5371	0.7329
No log	0.5951	366	0.5429	0.4002	0.5429	0.7368
No log	0.5984	368	0.5444	0.4827	0.5444	0.7379
No log	0.6016	370	0.6765	0.4957	0.6765	0.8225
No log	0.6049	372	0.8857	0.4147	0.8857	0.9411
No log	0.6081	374	0.8485	0.4278	0.8485	0.9212
No log	0.6114	376	0.6644	0.4761	0.6644	0.8151
No log	0.6146	378	0.5593	0.4031	0.5593	0.7479
No log	0.6179	380	0.6223	0.3338	0.6223	0.7889
No log	0.6211	382	0.6897	0.3238	0.6897	0.8305
No log	0.6244	384	0.6354	0.3185	0.6354	0.7971
No log	0.6276	386	0.5708	0.3777	0.5708	0.7555
No log	0.6309	388	0.6112	0.4198	0.6112	0.7818
No log	0.6341	390	0.6397	0.4126	0.6397	0.7998
No log	0.6374	392	0.5910	0.4154	0.5910	0.7687
No log	0.6407	394	0.5574	0.3774	0.5574	0.7466
No log	0.6439	396	0.5498	0.3828	0.5498	0.7415
No log	0.6472	398	0.5456	0.4216	0.5456	0.7386
No log	0.6504	400	0.5329	0.4426	0.5329	0.7300
No log	0.6537	402	0.5345	0.4633	0.5345	0.7311
No log	0.6569	404	0.5425	0.4879	0.5425	0.7366
No log	0.6602	406	0.5563	0.5208	0.5563	0.7459
No log	0.6634	408	0.5121	0.4907	0.5121	0.7156
No log	0.6667	410	0.5154	0.4665	0.5154	0.7179
No log	0.6699	412	0.5290	0.4801	0.5290	0.7273
No log	0.6732	414	0.6556	0.4955	0.6556	0.8097
No log	0.6764	416	0.7097	0.5064	0.7097	0.8424
No log	0.6797	418	0.6274	0.4823	0.6274	0.7921
No log	0.6829	420	0.5332	0.4722	0.5332	0.7302
No log	0.6862	422	0.5328	0.4437	0.5328	0.7299
No log	0.6894	424	0.5329	0.4899	0.5329	0.7300
No log	0.6927	426	0.6415	0.4938	0.6415	0.8009
No log	0.6959	428	0.8103	0.4836	0.8103	0.9002
No log	0.6992	430	0.7751	0.4902	0.7751	0.8804
No log	0.7024	432	0.5971	0.5222	0.5971	0.7727
No log	0.7057	434	0.5276	0.4933	0.5276	0.7263
No log	0.7089	436	0.5303	0.4879	0.5303	0.7282
No log	0.7122	438	0.5715	0.4914	0.5715	0.7560
No log	0.7154	440	0.6821	0.4900	0.6821	0.8259
No log	0.7187	442	0.6685	0.5126	0.6685	0.8176
No log	0.7220	444	0.5828	0.4644	0.5828	0.7634
No log	0.7252	446	0.5350	0.4595	0.5350	0.7314
No log	0.7285	448	0.5316	0.4576	0.5316	0.7291
No log	0.7317	450	0.5450	0.4750	0.5450	0.7382
No log	0.7350	452	0.5722	0.5073	0.5722	0.7564
No log	0.7382	454	0.6730	0.4898	0.6730	0.8204
No log	0.7415	456	0.6926	0.4983	0.6926	0.8322
No log	0.7447	458	0.5800	0.5097	0.5800	0.7616
No log	0.7480	460	0.5250	0.5067	0.5250	0.7246
No log	0.7512	462	0.5323	0.5132	0.5323	0.7296
No log	0.7545	464	0.6015	0.5249	0.6015	0.7756
No log	0.7577	466	0.6252	0.5174	0.6252	0.7907
No log	0.7610	468	0.6421	0.5209	0.6421	0.8013
No log	0.7642	470	0.5602	0.5451	0.5602	0.7485
No log	0.7675	472	0.5605	0.5457	0.5605	0.7487
No log	0.7707	474	0.6502	0.5225	0.6502	0.8063
No log	0.7740	476	0.6380	0.5321	0.6380	0.7988
No log	0.7772	478	0.6342	0.5126	0.6342	0.7964
No log	0.7805	480	0.6271	0.4962	0.6271	0.7919
No log	0.7837	482	0.6741	0.4502	0.6741	0.8210
No log	0.7870	484	0.6305	0.4725	0.6305	0.7940
No log	0.7902	486	0.5823	0.4695	0.5823	0.7631
No log	0.7935	488	0.5622	0.4725	0.5622	0.7498
No log	0.7967	490	0.6018	0.5096	0.6018	0.7758
No log	0.8	492	0.7127	0.4732	0.7127	0.8442
No log	0.8033	494	0.6445	0.5183	0.6445	0.8028
No log	0.8065	496	0.6629	0.5258	0.6629	0.8142
No log	0.8098	498	0.6493	0.5214	0.6493	0.8058
0.4845	0.8130	500	0.5611	0.5098	0.5611	0.7491
0.4845	0.8163	502	0.5779	0.5112	0.5779	0.7602
0.4845	0.8195	504	0.6916	0.4857	0.6916	0.8316
0.4845	0.8228	506	0.7736	0.5073	0.7736	0.8796
0.4845	0.8260	508	0.7244	0.5267	0.7244	0.8511
0.4845	0.8293	510	0.7107	0.5547	0.7107	0.8430
0.4845	0.8325	512	0.5751	0.5477	0.5751	0.7584
0.4845	0.8358	514	0.5801	0.5486	0.5801	0.7617
0.4845	0.8390	516	0.7720	0.5985	0.7720	0.8786
0.4845	0.8423	518	0.8193	0.6019	0.8193	0.9051
0.4845	0.8455	520	0.6077	0.5650	0.6077	0.7795
0.4845	0.8488	522	0.5748	0.5477	0.5748	0.7581
0.4845	0.8520	524	0.5997	0.5766	0.5997	0.7744
0.4845	0.8553	526	0.6785	0.5816	0.6785	0.8237
0.4845	0.8585	528	0.6462	0.5800	0.6462	0.8039
0.4845	0.8618	530	0.6101	0.5600	0.6101	0.7811
0.4845	0.8650	532	0.5479	0.5350	0.5479	0.7402
0.4845	0.8683	534	0.5602	0.5441	0.5602	0.7485
0.4845	0.8715	536	0.6480	0.5540	0.6480	0.8050
0.4845	0.8748	538	0.6611	0.5452	0.6611	0.8131
0.4845	0.8780	540	0.6301	0.5459	0.6301	0.7938
0.4845	0.8813	542	0.5686	0.4998	0.5686	0.7541
0.4845	0.8846	544	0.5647	0.5218	0.5647	0.7515
0.4845	0.8878	546	0.6392	0.5484	0.6392	0.7995
0.4845	0.8911	548	0.8241	0.5954	0.8241	0.9078
0.4845	0.8943	550	0.8256	0.5790	0.8256	0.9086
0.4845	0.8976	552	0.6322	0.5247	0.6322	0.7951
0.4845	0.9008	554	0.5692	0.5010	0.5692	0.7545
0.4845	0.9041	556	0.5806	0.4961	0.5806	0.7620
0.4845	0.9073	558	0.7057	0.5159	0.7057	0.8400
0.4845	0.9106	560	0.7210	0.5035	0.7210	0.8491
0.4845	0.9138	562	0.6079	0.4623	0.6079	0.7797
0.4845	0.9171	564	0.5804	0.4078	0.5804	0.7618
0.4845	0.9203	566	0.5836	0.4092	0.5836	0.7640
0.4845	0.9236	568	0.5940	0.4474	0.5940	0.7707

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1