ASAP_FineTuningBERT_AugV7_k7_task1_organization_fold1

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6804
• Qwk: 0.5174
• Mse: 0.6802
• Rmse: 0.8247

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 64
• eval_batch_size: 64
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.3333	2	11.6663	0.0	11.6637	3.4152
No log	0.6667	4	10.4403	-0.0009	10.4378	3.2308
No log	1.0	6	8.7161	0.0	8.7139	2.9519
No log	1.3333	8	7.2267	0.0	7.2247	2.6879
6.9302	1.6667	10	5.4345	0.0524	5.4331	2.3309
6.9302	2.0	12	4.4235	0.0040	4.4225	2.1030
6.9302	2.3333	14	3.6402	0.0	3.6393	1.9077
6.9302	2.6667	16	2.9111	0.0	2.9105	1.7060
6.9302	3.0	18	2.4187	0.0054	2.4183	1.5551
2.9524	3.3333	20	2.0141	0.0545	2.0139	1.4191
2.9524	3.6667	22	1.5942	0.0276	1.5942	1.2626
2.9524	4.0	24	1.4202	0.0172	1.4202	1.1917
2.9524	4.3333	26	1.3241	0.0106	1.3243	1.1508
2.9524	4.6667	28	1.3994	0.0276	1.3995	1.1830
1.7615	5.0	30	1.4248	0.0692	1.4248	1.1936
1.7615	5.3333	32	1.2984	0.0482	1.2984	1.1395
1.7615	5.6667	34	1.5630	0.1768	1.5628	1.2501
1.7615	6.0	36	1.5265	0.1719	1.5264	1.2355
1.7615	6.3333	38	1.3233	0.0910	1.3232	1.1503
1.7456	6.6667	40	1.3470	0.1496	1.3469	1.1606
1.7456	7.0	42	1.2333	0.1388	1.2333	1.1105
1.7456	7.3333	44	0.8648	0.1954	0.8649	0.9300
1.7456	7.6667	46	0.9408	0.2576	0.9408	0.9699
1.7456	8.0	48	0.8817	0.3368	0.8817	0.9390
1.319	8.3333	50	0.7414	0.4474	0.7414	0.8610
1.319	8.6667	52	0.8135	0.4331	0.8134	0.9019
1.319	9.0	54	0.7194	0.4809	0.7193	0.8481
1.319	9.3333	56	0.7254	0.3395	0.7254	0.8517
1.319	9.6667	58	0.6533	0.4710	0.6533	0.8083
0.8308	10.0	60	0.7045	0.4505	0.7044	0.8393
0.8308	10.3333	62	0.6272	0.4517	0.6272	0.7920
0.8308	10.6667	64	0.6230	0.4696	0.6230	0.7893
0.8308	11.0	66	0.6181	0.4801	0.6182	0.7863
0.8308	11.3333	68	0.7727	0.4848	0.7726	0.8790
0.4688	11.6667	70	0.6745	0.5417	0.6745	0.8213
0.4688	12.0	72	0.7657	0.4694	0.7660	0.8752
0.4688	12.3333	74	0.6500	0.5218	0.6502	0.8063
0.4688	12.6667	76	1.0883	0.4308	1.0880	1.0431
0.4688	13.0	78	1.0782	0.4434	1.0778	1.0382
0.388	13.3333	80	0.6966	0.5626	0.6967	0.8347
0.388	13.6667	82	0.6937	0.5660	0.6938	0.8330
0.388	14.0	84	1.1298	0.4362	1.1293	1.0627
0.388	14.3333	86	1.4093	0.3445	1.4087	1.1869
0.388	14.6667	88	0.7084	0.5468	0.7082	0.8416
0.3766	15.0	90	0.6829	0.5525	0.6830	0.8264
0.3766	15.3333	92	0.6542	0.5278	0.6540	0.8087
0.3766	15.6667	94	1.0184	0.3990	1.0179	1.0089
0.3766	16.0	96	0.7509	0.5247	0.7507	0.8664
0.3766	16.3333	98	0.7727	0.5188	0.7729	0.8791
0.2467	16.6667	100	0.7252	0.5305	0.7252	0.8516
0.2467	17.0	102	1.0867	0.3941	1.0864	1.0423
0.2467	17.3333	104	0.9274	0.4310	0.9271	0.9629
0.2467	17.6667	106	0.6828	0.5057	0.6828	0.8263
0.2467	18.0	108	0.6933	0.5063	0.6934	0.8327
0.2277	18.3333	110	0.7445	0.5134	0.7443	0.8627
0.2277	18.6667	112	0.7444	0.5189	0.7441	0.8626
0.2277	19.0	114	0.7159	0.5500	0.7159	0.8461
0.2277	19.3333	116	0.7401	0.5386	0.7399	0.8602
0.2277	19.6667	118	0.7158	0.5495	0.7156	0.8459
0.1454	20.0	120	0.6451	0.5484	0.6450	0.8031
0.1454	20.3333	122	0.7086	0.5418	0.7084	0.8416
0.1454	20.6667	124	0.7026	0.5406	0.7024	0.8381
0.1454	21.0	126	0.7252	0.5138	0.7250	0.8515
0.1454	21.3333	128	0.7702	0.4933	0.7699	0.8775
0.1249	21.6667	130	0.7108	0.4765	0.7106	0.8430
0.1249	22.0	132	0.7957	0.4711	0.7958	0.8920
0.1249	22.3333	134	0.8445	0.4627	0.8443	0.9189
0.1249	22.6667	136	0.8810	0.4202	0.8807	0.9385
0.1249	23.0	138	0.7817	0.4837	0.7816	0.8841
0.1331	23.3333	140	0.7661	0.5017	0.7658	0.8751
0.1331	23.6667	142	0.7137	0.5318	0.7135	0.8447
0.1331	24.0	144	0.7202	0.5430	0.7199	0.8485
0.1331	24.3333	146	0.6800	0.5394	0.6798	0.8245
0.1331	24.6667	148	0.6777	0.5495	0.6774	0.8231
0.0923	25.0	150	0.6757	0.5435	0.6755	0.8219
0.0923	25.3333	152	0.6548	0.5536	0.6546	0.8091
0.0923	25.6667	154	0.6750	0.5641	0.6747	0.8214
0.0923	26.0	156	0.6312	0.5587	0.6311	0.7944
0.0923	26.3333	158	0.6939	0.5101	0.6938	0.8330
0.0904	26.6667	160	0.7366	0.5377	0.7364	0.8581
0.0904	27.0	162	0.7386	0.5136	0.7384	0.8593
0.0904	27.3333	164	0.7098	0.4910	0.7097	0.8424
0.0904	27.6667	166	0.6921	0.5308	0.6919	0.8318
0.0904	28.0	168	0.6869	0.5378	0.6867	0.8287
0.0849	28.3333	170	0.6626	0.5526	0.6624	0.8139
0.0849	28.6667	172	0.6910	0.5460	0.6909	0.8312
0.0849	29.0	174	0.6438	0.5405	0.6437	0.8023
0.0849	29.3333	176	0.6622	0.5053	0.6621	0.8137
0.0849	29.6667	178	0.6504	0.5196	0.6503	0.8064
0.0791	30.0	180	0.6607	0.5366	0.6606	0.8128
0.0791	30.3333	182	0.6672	0.5087	0.6671	0.8167
0.0791	30.6667	184	0.6584	0.5156	0.6583	0.8114
0.0791	31.0	186	0.7040	0.4976	0.7039	0.8390
0.0791	31.3333	188	0.6992	0.5170	0.6990	0.8361
0.0678	31.6667	190	0.7351	0.5119	0.7349	0.8573
0.0678	32.0	192	0.7002	0.5147	0.7000	0.8367
0.0678	32.3333	194	0.6738	0.5290	0.6737	0.8208
0.0678	32.6667	196	0.6587	0.5319	0.6586	0.8115
0.0678	33.0	198	0.6861	0.5351	0.6859	0.8282
0.0608	33.3333	200	0.6716	0.5469	0.6714	0.8194
0.0608	33.6667	202	0.7030	0.5440	0.7030	0.8384
0.0608	34.0	204	0.6948	0.5333	0.6947	0.8335
0.0608	34.3333	206	0.7691	0.5102	0.7689	0.8768
0.0608	34.6667	208	0.6467	0.5300	0.6466	0.8041
0.0828	35.0	210	0.6644	0.5066	0.6643	0.8150
0.0828	35.3333	212	0.6739	0.5272	0.6737	0.8208
0.0828	35.6667	214	0.7145	0.5358	0.7143	0.8452
0.0828	36.0	216	0.6723	0.5021	0.6722	0.8199
0.0828	36.3333	218	0.6736	0.4921	0.6735	0.8207
0.0668	36.6667	220	0.7162	0.5258	0.7160	0.8462
0.0668	37.0	222	0.7272	0.5410	0.7270	0.8526
0.0668	37.3333	224	0.7644	0.4868	0.7643	0.8742
0.0668	37.6667	226	0.7722	0.4698	0.7722	0.8787
0.0668	38.0	228	0.7164	0.5094	0.7162	0.8463
0.0749	38.3333	230	0.7440	0.4744	0.7437	0.8624
0.0749	38.6667	232	0.6814	0.4753	0.6812	0.8254
0.0749	39.0	234	0.7007	0.4740	0.7007	0.8370
0.0749	39.3333	236	0.6888	0.5116	0.6886	0.8298
0.0749	39.6667	238	0.6746	0.5268	0.6745	0.8213
0.0558	40.0	240	0.6577	0.5479	0.6576	0.8109
0.0558	40.3333	242	0.6629	0.5409	0.6627	0.8141
0.0558	40.6667	244	0.6539	0.5371	0.6537	0.8085
0.0558	41.0	246	0.6712	0.5574	0.6710	0.8191
0.0558	41.3333	248	0.6829	0.5468	0.6827	0.8262
0.0549	41.6667	250	0.6853	0.5347	0.6851	0.8277
0.0549	42.0	252	0.6870	0.5299	0.6868	0.8288
0.0549	42.3333	254	0.6697	0.5206	0.6695	0.8182
0.0549	42.6667	256	0.6928	0.5032	0.6927	0.8323
0.0549	43.0	258	0.6814	0.5237	0.6813	0.8254
0.0539	43.3333	260	0.7134	0.5262	0.7132	0.8445
0.0539	43.6667	262	0.6919	0.5177	0.6917	0.8317
0.0539	44.0	264	0.7012	0.5283	0.7010	0.8372
0.0539	44.3333	266	0.7076	0.5220	0.7074	0.8411
0.0539	44.6667	268	0.6959	0.5297	0.6957	0.8341
0.0474	45.0	270	0.7460	0.5016	0.7457	0.8636
0.0474	45.3333	272	0.7324	0.5157	0.7321	0.8556
0.0474	45.6667	274	0.6687	0.5349	0.6684	0.8176
0.0474	46.0	276	0.6687	0.5416	0.6685	0.8176
0.0474	46.3333	278	0.7386	0.4905	0.7384	0.8593
0.0638	46.6667	280	0.7086	0.4872	0.7084	0.8416
0.0638	47.0	282	0.7407	0.4442	0.7406	0.8606
0.0638	47.3333	284	0.7565	0.4495	0.7563	0.8697
0.0638	47.6667	286	0.7745	0.4503	0.7742	0.8799
0.0638	48.0	288	0.8000	0.4290	0.7997	0.8943
0.0657	48.3333	290	0.7217	0.4621	0.7215	0.8494
0.0657	48.6667	292	0.7565	0.4723	0.7564	0.8697
0.0657	49.0	294	0.6979	0.4967	0.6977	0.8353
0.0657	49.3333	296	0.6774	0.5434	0.6772	0.8229
0.0657	49.6667	298	0.6644	0.5473	0.6642	0.8150
0.0518	50.0	300	0.6449	0.5304	0.6448	0.8030
0.0518	50.3333	302	0.6671	0.5366	0.6669	0.8166
0.0518	50.6667	304	0.7376	0.4982	0.7373	0.8587
0.0518	51.0	306	0.7034	0.5262	0.7031	0.8385
0.0518	51.3333	308	0.6956	0.4810	0.6954	0.8339
0.0447	51.6667	310	0.6982	0.5137	0.6980	0.8354
0.0447	52.0	312	0.7081	0.5045	0.7079	0.8414
0.0447	52.3333	314	0.6638	0.5121	0.6636	0.8146
0.0447	52.6667	316	0.6693	0.4995	0.6691	0.8180
0.0447	53.0	318	0.6867	0.5188	0.6865	0.8286
0.0465	53.3333	320	0.6995	0.5256	0.6993	0.8362
0.0465	53.6667	322	0.6900	0.4972	0.6898	0.8305
0.0465	54.0	324	0.6719	0.5144	0.6717	0.8196
0.0465	54.3333	326	0.6729	0.5318	0.6727	0.8202
0.0465	54.6667	328	0.6545	0.5362	0.6544	0.8089
0.0432	55.0	330	0.6790	0.5527	0.6788	0.8239
0.0432	55.3333	332	0.6939	0.5509	0.6937	0.8329
0.0432	55.6667	334	0.6780	0.5438	0.6778	0.8233
0.0432	56.0	336	0.6870	0.5418	0.6867	0.8287
0.0432	56.3333	338	0.6738	0.5361	0.6736	0.8207
0.0381	56.6667	340	0.6761	0.4891	0.6760	0.8222
0.0381	57.0	342	0.6969	0.5103	0.6967	0.8347
0.0381	57.3333	344	0.7114	0.5001	0.7112	0.8433
0.0381	57.6667	346	0.7145	0.4707	0.7144	0.8452
0.0381	58.0	348	0.7185	0.4808	0.7183	0.8475
0.0378	58.3333	350	0.7050	0.4758	0.7048	0.8395
0.0378	58.6667	352	0.6974	0.5175	0.6972	0.8350
0.0378	59.0	354	0.6786	0.5107	0.6784	0.8236
0.0378	59.3333	356	0.6706	0.5301	0.6703	0.8187
0.0378	59.6667	358	0.6679	0.5314	0.6676	0.8171
0.0386	60.0	360	0.6583	0.5389	0.6580	0.8112
0.0386	60.3333	362	0.6569	0.5347	0.6567	0.8103
0.0386	60.6667	364	0.6710	0.5249	0.6708	0.8190
0.0386	61.0	366	0.6944	0.4992	0.6942	0.8332
0.0386	61.3333	368	0.7073	0.4986	0.7071	0.8409
0.0398	61.6667	370	0.7021	0.4990	0.7018	0.8378
0.0398	62.0	372	0.6988	0.4929	0.6986	0.8358
0.0398	62.3333	374	0.6961	0.4830	0.6959	0.8342
0.0398	62.6667	376	0.6932	0.5036	0.6930	0.8325
0.0398	63.0	378	0.6888	0.5210	0.6885	0.8298
0.0378	63.3333	380	0.6682	0.5422	0.6680	0.8173
0.0378	63.6667	382	0.6490	0.5414	0.6487	0.8054
0.0378	64.0	384	0.6488	0.5535	0.6485	0.8053
0.0378	64.3333	386	0.6935	0.5484	0.6931	0.8325
0.0378	64.6667	388	0.6612	0.5565	0.6609	0.8130
0.0447	65.0	390	0.6505	0.5447	0.6502	0.8064
0.0447	65.3333	392	0.6683	0.5394	0.6680	0.8173
0.0447	65.6667	394	0.7114	0.5321	0.7111	0.8433
0.0447	66.0	396	0.7109	0.5213	0.7106	0.8430
0.0447	66.3333	398	0.6951	0.4914	0.6948	0.8336
0.0337	66.6667	400	0.7112	0.4929	0.7110	0.8432
0.0337	67.0	402	0.7416	0.4921	0.7413	0.8610
0.0337	67.3333	404	0.7085	0.4867	0.7083	0.8416
0.0337	67.6667	406	0.7067	0.4989	0.7065	0.8405
0.0337	68.0	408	0.7092	0.4897	0.7090	0.8420
0.0363	68.3333	410	0.7195	0.4876	0.7192	0.8481
0.0363	68.6667	412	0.6975	0.4902	0.6973	0.8350
0.0363	69.0	414	0.6983	0.5020	0.6981	0.8355
0.0363	69.3333	416	0.7294	0.4835	0.7292	0.8539
0.0363	69.6667	418	0.7155	0.4913	0.7153	0.8458
0.0341	70.0	420	0.6812	0.5029	0.6810	0.8252
0.0341	70.3333	422	0.6818	0.5079	0.6816	0.8256
0.0341	70.6667	424	0.6953	0.5010	0.6951	0.8337
0.0341	71.0	426	0.7040	0.5158	0.7038	0.8389
0.0341	71.3333	428	0.6809	0.5275	0.6808	0.8251
0.0329	71.6667	430	0.6774	0.5123	0.6773	0.8230
0.0329	72.0	432	0.6672	0.5149	0.6671	0.8168
0.0329	72.3333	434	0.6661	0.5247	0.6660	0.8161
0.0329	72.6667	436	0.6730	0.5195	0.6729	0.8203
0.0329	73.0	438	0.6840	0.5310	0.6838	0.8269
0.0328	73.3333	440	0.6899	0.5346	0.6897	0.8305
0.0328	73.6667	442	0.6861	0.5371	0.6858	0.8281
0.0328	74.0	444	0.6893	0.5145	0.6891	0.8301
0.0328	74.3333	446	0.6820	0.5251	0.6817	0.8257
0.0328	74.6667	448	0.6716	0.5282	0.6714	0.8194
0.0293	75.0	450	0.6692	0.5282	0.6690	0.8179
0.0293	75.3333	452	0.6742	0.5256	0.6740	0.8210
0.0293	75.6667	454	0.6733	0.5234	0.6731	0.8204
0.0293	76.0	456	0.6691	0.5100	0.6689	0.8179
0.0293	76.3333	458	0.6729	0.5081	0.6728	0.8202
0.0354	76.6667	460	0.6886	0.5136	0.6884	0.8297
0.0354	77.0	462	0.6829	0.5187	0.6827	0.8263
0.0354	77.3333	464	0.6788	0.5202	0.6787	0.8238
0.0354	77.6667	466	0.6782	0.5241	0.6780	0.8234
0.0354	78.0	468	0.6717	0.5245	0.6715	0.8194
0.0297	78.3333	470	0.6607	0.5369	0.6605	0.8127
0.0297	78.6667	472	0.6582	0.5378	0.6581	0.8112
0.0297	79.0	474	0.6531	0.5384	0.6530	0.8081
0.0297	79.3333	476	0.6586	0.5487	0.6584	0.8114
0.0297	79.6667	478	0.6721	0.5376	0.6719	0.8197
0.0277	80.0	480	0.6693	0.5483	0.6691	0.8180
0.0277	80.3333	482	0.6733	0.5395	0.6731	0.8204
0.0277	80.6667	484	0.6762	0.5389	0.6760	0.8222
0.0277	81.0	486	0.6769	0.5230	0.6767	0.8226
0.0277	81.3333	488	0.6810	0.5153	0.6808	0.8251
0.026	81.6667	490	0.6831	0.5252	0.6830	0.8264
0.026	82.0	492	0.6811	0.5069	0.6810	0.8252
0.026	82.3333	494	0.6825	0.5090	0.6823	0.8260
0.026	82.6667	496	0.6793	0.5004	0.6791	0.8241
0.026	83.0	498	0.6799	0.4910	0.6797	0.8245
0.0271	83.3333	500	0.6833	0.4848	0.6831	0.8265
0.0271	83.6667	502	0.6867	0.4889	0.6865	0.8286
0.0271	84.0	504	0.6861	0.5007	0.6860	0.8282
0.0271	84.3333	506	0.6932	0.5053	0.6930	0.8325
0.0271	84.6667	508	0.6917	0.5121	0.6915	0.8315
0.0267	85.0	510	0.6860	0.5205	0.6858	0.8281
0.0267	85.3333	512	0.6847	0.5201	0.6845	0.8274
0.0267	85.6667	514	0.6861	0.5237	0.6859	0.8282
0.0267	86.0	516	0.6879	0.5319	0.6876	0.8292
0.0267	86.3333	518	0.6792	0.5342	0.6790	0.8240
0.0263	86.6667	520	0.6728	0.5321	0.6725	0.8201
0.0263	87.0	522	0.6652	0.5327	0.6650	0.8155
0.0263	87.3333	524	0.6650	0.5362	0.6648	0.8153
0.0263	87.6667	526	0.6713	0.5344	0.6710	0.8192
0.0263	88.0	528	0.6738	0.5294	0.6736	0.8207
0.0243	88.3333	530	0.6735	0.5323	0.6732	0.8205
0.0243	88.6667	532	0.6738	0.5354	0.6736	0.8207
0.0243	89.0	534	0.6728	0.5342	0.6726	0.8201
0.0243	89.3333	536	0.6669	0.5332	0.6667	0.8165
0.0243	89.6667	538	0.6651	0.5435	0.6649	0.8154
0.0255	90.0	540	0.6649	0.5370	0.6647	0.8153
0.0255	90.3333	542	0.6676	0.5330	0.6674	0.8169
0.0255	90.6667	544	0.6751	0.5340	0.6748	0.8215
0.0255	91.0	546	0.6792	0.5333	0.6789	0.8240
0.0255	91.3333	548	0.6816	0.5351	0.6814	0.8255
0.0254	91.6667	550	0.6737	0.5331	0.6734	0.8206
0.0254	92.0	552	0.6679	0.5281	0.6677	0.8171
0.0254	92.3333	554	0.6685	0.5180	0.6683	0.8175
0.0254	92.6667	556	0.6710	0.5180	0.6708	0.8190
0.0254	93.0	558	0.6761	0.5253	0.6759	0.8222
0.0295	93.3333	560	0.6826	0.5246	0.6823	0.8260
0.0295	93.6667	562	0.6844	0.5192	0.6842	0.8272
0.0295	94.0	564	0.6858	0.5192	0.6856	0.8280
0.0295	94.3333	566	0.6831	0.5182	0.6829	0.8264
0.0295	94.6667	568	0.6841	0.5182	0.6839	0.8270
0.025	95.0	570	0.6831	0.5182	0.6829	0.8264
0.025	95.3333	572	0.6815	0.5053	0.6813	0.8254
0.025	95.6667	574	0.6791	0.5007	0.6789	0.8239
0.025	96.0	576	0.6774	0.5007	0.6772	0.8229
0.025	96.3333	578	0.6762	0.5007	0.6760	0.8222
0.0272	96.6667	580	0.6766	0.5024	0.6765	0.8225
0.0272	97.0	582	0.6779	0.5140	0.6777	0.8232
0.0272	97.3333	584	0.6785	0.5150	0.6783	0.8236
0.0272	97.6667	586	0.6788	0.5129	0.6786	0.8238
0.0272	98.0	588	0.6792	0.5140	0.6790	0.8240
0.0247	98.3333	590	0.6787	0.5113	0.6785	0.8237
0.0247	98.6667	592	0.6786	0.5070	0.6784	0.8236
0.0247	99.0	594	0.6790	0.5091	0.6788	0.8239
0.0247	99.3333	596	0.6799	0.5153	0.6797	0.8244
0.0247	99.6667	598	0.6803	0.5174	0.6801	0.8247
0.0245	100.0	600	0.6804	0.5174	0.6802	0.8247

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.1+cu121
• Datasets 3.2.0
• Tokenizers 0.19.1