ASAP_FineTuningBERT_AugV7_k7_task1_organization_fold4

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8798
• Qwk: 0.5718
• Mse: 0.8798
• Rmse: 0.9380

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 64
• eval_batch_size: 64
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.3333	2	10.5724	0.0077	10.5724	3.2515
No log	0.6667	4	8.1136	0.0018	8.1136	2.8484
No log	1.0	6	6.3467	0.0	6.3467	2.5193
No log	1.3333	8	4.6445	0.0099	4.6445	2.1551
5.7868	1.6667	10	3.6175	0.0040	3.6175	1.9020
5.7868	2.0	12	2.8453	0.0040	2.8453	1.6868
5.7868	2.3333	14	2.1200	0.1086	2.1200	1.4560
5.7868	2.6667	16	1.6562	0.0342	1.6562	1.2869
5.7868	3.0	18	1.4406	0.0316	1.4406	1.2003
1.9765	3.3333	20	1.1831	0.0316	1.1831	1.0877
1.9765	3.6667	22	1.2155	0.0316	1.2155	1.1025
1.9765	4.0	24	1.3094	0.0316	1.3094	1.1443
1.9765	4.3333	26	1.3640	0.0316	1.3640	1.1679
1.9765	4.6667	28	1.3092	0.0316	1.3092	1.1442
1.8599	5.0	30	1.5126	0.0316	1.5126	1.2299
1.8599	5.3333	32	1.6101	0.0342	1.6101	1.2689
1.8599	5.6667	34	1.4557	0.0522	1.4557	1.2065
1.8599	6.0	36	1.4589	0.0634	1.4589	1.2079
1.8599	6.3333	38	1.3757	0.0743	1.3757	1.1729
1.7768	6.6667	40	1.0779	0.0547	1.0779	1.0382
1.7768	7.0	42	1.1693	0.0342	1.1693	1.0814
1.7768	7.3333	44	1.1334	0.0648	1.1334	1.0646
1.7768	7.6667	46	1.3173	0.1256	1.3173	1.1478
1.7768	8.0	48	1.6110	0.2021	1.6110	1.2692
1.6433	8.3333	50	1.3546	0.1769	1.3546	1.1639
1.6433	8.6667	52	1.0345	0.1700	1.0345	1.0171
1.6433	9.0	54	1.3102	0.1506	1.3102	1.1446
1.6433	9.3333	56	0.8517	0.2162	0.8517	0.9229
1.6433	9.6667	58	0.9323	0.1004	0.9323	0.9655
1.5596	10.0	60	1.5439	0.1528	1.5439	1.2425
1.5596	10.3333	62	1.6290	0.1409	1.6290	1.2763
1.5596	10.6667	64	0.8750	0.2442	0.8750	0.9354
1.5596	11.0	66	1.0145	0.1770	1.0145	1.0072
1.5596	11.3333	68	0.9538	0.2187	0.9538	0.9767
1.4143	11.6667	70	1.0687	0.2855	1.0687	1.0338
1.4143	12.0	72	0.7749	0.3947	0.7749	0.8803
1.4143	12.3333	74	0.8113	0.2864	0.8113	0.9007
1.4143	12.6667	76	0.7395	0.3745	0.7395	0.8599
1.4143	13.0	78	0.8310	0.3818	0.8310	0.9116
0.9351	13.3333	80	0.6498	0.4537	0.6498	0.8061
0.9351	13.6667	82	0.6540	0.4905	0.6540	0.8087
0.9351	14.0	84	0.7091	0.4961	0.7091	0.8421
0.9351	14.3333	86	0.6330	0.4943	0.6330	0.7956
0.9351	14.6667	88	0.6440	0.4918	0.6440	0.8025
0.5722	15.0	90	0.7793	0.4731	0.7793	0.8828
0.5722	15.3333	92	0.6945	0.5049	0.6945	0.8334
0.5722	15.6667	94	0.6467	0.5385	0.6467	0.8042
0.5722	16.0	96	0.7046	0.5009	0.7046	0.8394
0.5722	16.3333	98	0.7996	0.4503	0.7996	0.8942
0.4281	16.6667	100	0.7591	0.4819	0.7591	0.8713
0.4281	17.0	102	0.7575	0.4744	0.7575	0.8703
0.4281	17.3333	104	0.7680	0.4904	0.7680	0.8764
0.4281	17.6667	106	0.7126	0.5137	0.7126	0.8441
0.4281	18.0	108	0.6920	0.5544	0.6920	0.8319
0.2585	18.3333	110	0.6923	0.5411	0.6923	0.8321
0.2585	18.6667	112	0.7047	0.5607	0.7047	0.8395
0.2585	19.0	114	0.7444	0.5612	0.7444	0.8628
0.2585	19.3333	116	0.7281	0.5743	0.7281	0.8533
0.2585	19.6667	118	0.7805	0.5654	0.7805	0.8834
0.1892	20.0	120	0.8327	0.5424	0.8327	0.9125
0.1892	20.3333	122	0.8715	0.5277	0.8715	0.9335
0.1892	20.6667	124	0.8521	0.5272	0.8521	0.9231
0.1892	21.0	126	0.7815	0.6013	0.7815	0.8840
0.1892	21.3333	128	0.7309	0.6241	0.7309	0.8549
0.1826	21.6667	130	0.7799	0.5855	0.7799	0.8831
0.1826	22.0	132	0.8291	0.5795	0.8291	0.9106
0.1826	22.3333	134	0.8008	0.5830	0.8008	0.8949
0.1826	22.6667	136	0.7626	0.6086	0.7626	0.8733
0.1826	23.0	138	0.7426	0.6153	0.7426	0.8618
0.1544	23.3333	140	0.7475	0.6173	0.7475	0.8646
0.1544	23.6667	142	0.7663	0.6021	0.7663	0.8754
0.1544	24.0	144	0.7789	0.5947	0.7789	0.8826
0.1544	24.3333	146	0.7449	0.5988	0.7449	0.8631
0.1544	24.6667	148	0.6546	0.6226	0.6546	0.8091
0.1262	25.0	150	0.6597	0.6135	0.6597	0.8122
0.1262	25.3333	152	0.7627	0.5761	0.7627	0.8733
0.1262	25.6667	154	0.8716	0.5446	0.8716	0.9336
0.1262	26.0	156	0.7569	0.5740	0.7569	0.8700
0.1262	26.3333	158	0.7302	0.5716	0.7302	0.8545
0.1128	26.6667	160	0.8188	0.5644	0.8188	0.9049
0.1128	27.0	162	0.8592	0.5508	0.8592	0.9269
0.1128	27.3333	164	0.7466	0.5697	0.7466	0.8641
0.1128	27.6667	166	0.7481	0.5469	0.7481	0.8649
0.1128	28.0	168	0.8407	0.5522	0.8407	0.9169
0.1433	28.3333	170	0.8218	0.5434	0.8218	0.9065
0.1433	28.6667	172	0.6806	0.6035	0.6806	0.8250
0.1433	29.0	174	0.6866	0.6171	0.6866	0.8286
0.1433	29.3333	176	0.8605	0.5484	0.8605	0.9276
0.1433	29.6667	178	0.9070	0.5568	0.9070	0.9524
0.1079	30.0	180	0.7929	0.5948	0.7929	0.8905
0.1079	30.3333	182	0.7044	0.6284	0.7044	0.8393
0.1079	30.6667	184	0.7707	0.5922	0.7707	0.8779
0.1079	31.0	186	0.9560	0.5400	0.9560	0.9777
0.1079	31.3333	188	0.9297	0.5506	0.9297	0.9642
0.092	31.6667	190	0.7692	0.5957	0.7692	0.8771
0.092	32.0	192	0.7174	0.6303	0.7174	0.8470
0.092	32.3333	194	0.7733	0.6026	0.7733	0.8794
0.092	32.6667	196	0.8110	0.6010	0.8110	0.9005
0.092	33.0	198	0.8051	0.5883	0.8051	0.8973
0.0976	33.3333	200	0.6918	0.6198	0.6918	0.8317
0.0976	33.6667	202	0.6743	0.6226	0.6743	0.8212
0.0976	34.0	204	0.8139	0.5959	0.8139	0.9022
0.0976	34.3333	206	0.8934	0.5727	0.8934	0.9452
0.0976	34.6667	208	0.7783	0.6076	0.7783	0.8822
0.0927	35.0	210	0.7087	0.6207	0.7087	0.8418
0.0927	35.3333	212	0.8031	0.5952	0.8031	0.8962
0.0927	35.6667	214	0.9950	0.5513	0.9950	0.9975
0.0927	36.0	216	0.8390	0.5943	0.8390	0.9160
0.0927	36.3333	218	0.7459	0.6031	0.7459	0.8636
0.0981	36.6667	220	0.8222	0.5866	0.8222	0.9067
0.0981	37.0	222	0.9774	0.5493	0.9774	0.9886
0.0981	37.3333	224	0.9323	0.5628	0.9323	0.9655
0.0981	37.6667	226	0.8338	0.5799	0.8338	0.9131
0.0981	38.0	228	0.7863	0.5865	0.7863	0.8867
0.0859	38.3333	230	0.8199	0.5822	0.8199	0.9055
0.0859	38.6667	232	0.9414	0.5562	0.9414	0.9702
0.0859	39.0	234	0.8484	0.5743	0.8484	0.9211
0.0859	39.3333	236	0.7750	0.6060	0.7750	0.8803
0.0859	39.6667	238	0.8253	0.5890	0.8253	0.9085
0.0686	40.0	240	0.8320	0.5868	0.8320	0.9121
0.0686	40.3333	242	0.7167	0.6291	0.7167	0.8466
0.0686	40.6667	244	0.7004	0.6394	0.7004	0.8369
0.0686	41.0	246	0.7295	0.6381	0.7295	0.8541
0.0686	41.3333	248	0.7712	0.6060	0.7712	0.8782
0.0771	41.6667	250	0.8889	0.5882	0.8889	0.9428
0.0771	42.0	252	0.8513	0.5882	0.8513	0.9227
0.0771	42.3333	254	0.7714	0.6071	0.7714	0.8783
0.0771	42.6667	256	0.8184	0.6061	0.8184	0.9046
0.0771	43.0	258	0.8144	0.5944	0.8144	0.9024
0.0685	43.3333	260	0.7371	0.6203	0.7371	0.8586
0.0685	43.6667	262	0.8394	0.5939	0.8394	0.9162
0.0685	44.0	264	0.9492	0.5441	0.9492	0.9743
0.0685	44.3333	266	0.8484	0.5747	0.8484	0.9211
0.0685	44.6667	268	0.7945	0.6019	0.7945	0.8914
0.0567	45.0	270	0.7040	0.6239	0.7040	0.8391
0.0567	45.3333	272	0.7632	0.6108	0.7632	0.8736
0.0567	45.6667	274	0.9465	0.5451	0.9465	0.9729
0.0567	46.0	276	0.9759	0.5546	0.9759	0.9879
0.0567	46.3333	278	0.8932	0.5653	0.8932	0.9451
0.0721	46.6667	280	0.8482	0.5687	0.8482	0.9210
0.0721	47.0	282	0.7699	0.6235	0.7699	0.8775
0.0721	47.3333	284	0.6843	0.6270	0.6843	0.8272
0.0721	47.6667	286	0.6757	0.6425	0.6757	0.8220
0.0721	48.0	288	0.7729	0.6051	0.7729	0.8792
0.0809	48.3333	290	0.8952	0.5706	0.8952	0.9461
0.0809	48.6667	292	0.9701	0.5521	0.9701	0.9850
0.0809	49.0	294	0.9361	0.5680	0.9361	0.9675
0.0809	49.3333	296	0.8241	0.5963	0.8241	0.9078
0.0809	49.6667	298	0.7370	0.6257	0.7370	0.8585
0.0638	50.0	300	0.8222	0.5816	0.8222	0.9067
0.0638	50.3333	302	0.9086	0.5635	0.9086	0.9532
0.0638	50.6667	304	0.7738	0.6019	0.7738	0.8797
0.0638	51.0	306	0.7129	0.6319	0.7129	0.8443
0.0638	51.3333	308	0.7486	0.6291	0.7486	0.8652
0.0572	51.6667	310	0.8733	0.5778	0.8733	0.9345
0.0572	52.0	312	0.8188	0.5888	0.8188	0.9049
0.0572	52.3333	314	0.7150	0.6144	0.7150	0.8456
0.0572	52.6667	316	0.7231	0.6253	0.7231	0.8504
0.0572	53.0	318	0.8457	0.5727	0.8457	0.9196
0.0608	53.3333	320	0.8911	0.5708	0.8911	0.9440
0.0608	53.6667	322	0.8181	0.5946	0.8181	0.9045
0.0608	54.0	324	0.7254	0.6157	0.7254	0.8517
0.0608	54.3333	326	0.7581	0.6014	0.7581	0.8707
0.0608	54.6667	328	0.8209	0.5801	0.8209	0.9060
0.0574	55.0	330	0.8198	0.5857	0.8198	0.9054
0.0574	55.3333	332	0.8680	0.5754	0.8680	0.9317
0.0574	55.6667	334	0.9293	0.5438	0.9293	0.9640
0.0574	56.0	336	0.9554	0.5371	0.9554	0.9775
0.0574	56.3333	338	0.8642	0.5825	0.8642	0.9296
0.0656	56.6667	340	0.8099	0.5973	0.8099	0.9000
0.0656	57.0	342	0.7855	0.6026	0.7855	0.8863
0.0656	57.3333	344	0.7331	0.6396	0.7331	0.8562
0.0656	57.6667	346	0.8236	0.5876	0.8236	0.9075
0.0656	58.0	348	0.9580	0.5584	0.9580	0.9788
0.0592	58.3333	350	0.9873	0.5589	0.9873	0.9936
0.0592	58.6667	352	0.9433	0.5505	0.9433	0.9712
0.0592	59.0	354	0.8322	0.5829	0.8322	0.9122
0.0592	59.3333	356	0.8128	0.5849	0.8128	0.9016
0.0592	59.6667	358	0.8679	0.5707	0.8679	0.9316
0.0563	60.0	360	1.0010	0.5342	1.0010	1.0005
0.0563	60.3333	362	0.9537	0.5414	0.9537	0.9766
0.0563	60.6667	364	0.8644	0.5792	0.8644	0.9297
0.0563	61.0	366	0.8018	0.6026	0.8018	0.8954
0.0563	61.3333	368	0.8261	0.5967	0.8261	0.9089
0.0503	61.6667	370	0.8950	0.5732	0.8950	0.9461
0.0503	62.0	372	0.8495	0.5956	0.8495	0.9217
0.0503	62.3333	374	0.8530	0.5902	0.8530	0.9236
0.0503	62.6667	376	0.8617	0.5890	0.8617	0.9283
0.0503	63.0	378	0.8125	0.5907	0.8125	0.9014
0.0519	63.3333	380	0.8600	0.5796	0.8600	0.9274
0.0519	63.6667	382	0.9311	0.5753	0.9311	0.9650
0.0519	64.0	384	0.9330	0.5610	0.9330	0.9659
0.0519	64.3333	386	0.8391	0.5981	0.8391	0.9160
0.0519	64.6667	388	0.8016	0.5995	0.8016	0.8953
0.0494	65.0	390	0.8452	0.5983	0.8452	0.9194
0.0494	65.3333	392	0.9096	0.5701	0.9096	0.9538
0.0494	65.6667	394	0.9875	0.5634	0.9875	0.9937
0.0494	66.0	396	0.8832	0.6018	0.8832	0.9398
0.0494	66.3333	398	0.8239	0.6049	0.8239	0.9077
0.0465	66.6667	400	0.8162	0.6115	0.8162	0.9034
0.0465	67.0	402	0.8813	0.5980	0.8813	0.9388
0.0465	67.3333	404	0.8665	0.5999	0.8665	0.9309
0.0465	67.6667	406	0.7944	0.6104	0.7944	0.8913
0.0465	68.0	408	0.8093	0.6060	0.8093	0.8996
0.0488	68.3333	410	0.9576	0.5557	0.9576	0.9786
0.0488	68.6667	412	1.1624	0.5266	1.1624	1.0781
0.0488	69.0	414	1.1728	0.5168	1.1728	1.0829
0.0488	69.3333	416	1.0101	0.5438	1.0101	1.0050
0.0488	69.6667	418	0.8623	0.5758	0.8623	0.9286
0.0459	70.0	420	0.8495	0.5748	0.8495	0.9217
0.0459	70.3333	422	0.9111	0.5560	0.9111	0.9545
0.0459	70.6667	424	1.0038	0.5475	1.0038	1.0019
0.0459	71.0	426	0.9736	0.5598	0.9736	0.9867
0.0459	71.3333	428	0.9616	0.5335	0.9616	0.9806
0.0429	71.6667	430	0.9319	0.5550	0.9319	0.9653
0.0429	72.0	432	0.8697	0.5716	0.8697	0.9326
0.0429	72.3333	434	0.9007	0.5701	0.9007	0.9490
0.0429	72.6667	436	0.9680	0.5595	0.9680	0.9839
0.0429	73.0	438	0.9450	0.5655	0.9450	0.9721
0.042	73.3333	440	0.8516	0.5814	0.8516	0.9228
0.042	73.6667	442	0.8347	0.5950	0.8347	0.9136
0.042	74.0	444	0.8989	0.5766	0.8989	0.9481
0.042	74.3333	446	1.0267	0.5614	1.0267	1.0133
0.042	74.6667	448	1.0910	0.5322	1.0910	1.0445
0.0469	75.0	450	1.0076	0.5510	1.0076	1.0038
0.0469	75.3333	452	0.8661	0.5796	0.8661	0.9306
0.0469	75.6667	454	0.8294	0.5909	0.8294	0.9107
0.0469	76.0	456	0.8845	0.5760	0.8845	0.9405
0.0469	76.3333	458	0.9884	0.5507	0.9884	0.9942
0.0393	76.6667	460	0.9893	0.5580	0.9893	0.9946
0.0393	77.0	462	0.9615	0.5495	0.9615	0.9806
0.0393	77.3333	464	0.9100	0.5743	0.9100	0.9539
0.0393	77.6667	466	0.8661	0.5752	0.8661	0.9306
0.0393	78.0	468	0.8271	0.5906	0.8271	0.9095
0.0452	78.3333	470	0.8358	0.5891	0.8358	0.9142
0.0452	78.6667	472	0.9207	0.5674	0.9207	0.9596
0.0452	79.0	474	1.0403	0.5461	1.0403	1.0200
0.0452	79.3333	476	1.0533	0.5454	1.0533	1.0263
0.0452	79.6667	478	0.9651	0.5535	0.9651	0.9824
0.0424	80.0	480	0.8650	0.5746	0.8650	0.9301
0.0424	80.3333	482	0.8197	0.5849	0.8197	0.9053
0.0424	80.6667	484	0.8343	0.5927	0.8343	0.9134
0.0424	81.0	486	0.9165	0.5703	0.9165	0.9573
0.0424	81.3333	488	0.9594	0.5561	0.9594	0.9795
0.0398	81.6667	490	0.9304	0.5701	0.9304	0.9646
0.0398	82.0	492	0.8796	0.5744	0.8796	0.9378
0.0398	82.3333	494	0.8786	0.5765	0.8786	0.9373
0.0398	82.6667	496	0.9206	0.5692	0.9206	0.9595
0.0398	83.0	498	0.9503	0.5641	0.9503	0.9748
0.0374	83.3333	500	0.9277	0.5757	0.9277	0.9632
0.0374	83.6667	502	0.8964	0.5799	0.8964	0.9468
0.0374	84.0	504	0.8812	0.5756	0.8812	0.9387
0.0374	84.3333	506	0.8701	0.5874	0.8701	0.9328
0.0374	84.6667	508	0.8895	0.5780	0.8895	0.9431
0.0339	85.0	510	0.9283	0.5657	0.9283	0.9635
0.0339	85.3333	512	0.9647	0.5542	0.9647	0.9822
0.0339	85.6667	514	0.9607	0.5534	0.9607	0.9801
0.0339	86.0	516	0.9176	0.5679	0.9176	0.9579
0.0339	86.3333	518	0.8798	0.5718	0.8798	0.9380

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.1+cu121
• Datasets 3.2.0
• Tokenizers 0.19.1