ASAP_FineTuningBERT_Aug_k35_task1_organization_fold1

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6348
• Qwk: 0.5827
• Mse: 0.6348
• Rmse: 0.7967

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0036	2	10.4078	0.0	10.4078	3.2261
No log	0.0072	4	7.7067	0.0216	7.7067	2.7761
No log	0.0108	6	6.8190	0.0018	6.8190	2.6113
No log	0.0144	8	5.9173	0.0	5.9173	2.4325
No log	0.0180	10	5.2505	0.0	5.2505	2.2914
No log	0.0216	12	4.5423	0.0	4.5423	2.1313
No log	0.0252	14	3.7364	0.0148	3.7364	1.9330
No log	0.0288	16	3.0722	0.0128	3.0722	1.7528
No log	0.0324	18	2.5121	0.0040	2.5121	1.5850
No log	0.0360	20	2.0162	0.0	2.0162	1.4199
No log	0.0396	22	1.6393	0.0	1.6393	1.2803
No log	0.0432	24	1.3365	0.1140	1.3365	1.1561
No log	0.0468	26	1.1384	0.0211	1.1384	1.0670
No log	0.0504	28	0.9815	0.0106	0.9815	0.9907
No log	0.0540	30	0.9036	0.0	0.9036	0.9506
No log	0.0576	32	0.9018	0.0	0.9018	0.9496
No log	0.0612	34	0.9276	0.0	0.9276	0.9631
No log	0.0647	36	0.8706	0.0	0.8706	0.9331
No log	0.0683	38	0.8575	0.0	0.8575	0.9260
No log	0.0719	40	0.8527	0.0	0.8527	0.9234
No log	0.0755	42	0.9834	-0.0060	0.9834	0.9917
No log	0.0791	44	0.9865	0.0	0.9865	0.9932
No log	0.0827	46	0.8625	0.0	0.8625	0.9287
No log	0.0863	48	0.8562	0.0	0.8562	0.9253
No log	0.0899	50	0.8528	0.0	0.8528	0.9235
No log	0.0935	52	0.9113	0.0	0.9113	0.9546
No log	0.0971	54	1.0349	0.0	1.0349	1.0173
No log	0.1007	56	1.0130	0.0	1.0130	1.0065
No log	0.1043	58	0.9439	0.0	0.9439	0.9716
No log	0.1079	60	0.8848	0.0	0.8848	0.9406
No log	0.1115	62	0.8398	0.0	0.8398	0.9164
No log	0.1151	64	0.8577	0.0	0.8577	0.9261
No log	0.1187	66	0.8400	0.1391	0.8400	0.9165
No log	0.1223	68	0.7914	0.0158	0.7914	0.8896
No log	0.1259	70	0.8414	0.1735	0.8414	0.9173
No log	0.1295	72	0.8480	0.0315	0.8480	0.9209
No log	0.1331	74	0.8258	0.0106	0.8258	0.9087
No log	0.1367	76	0.8067	0.0106	0.8067	0.8982
No log	0.1403	78	0.7903	0.0106	0.7903	0.8890
No log	0.1439	80	0.7754	0.0106	0.7754	0.8806
No log	0.1475	82	0.7782	0.0211	0.7782	0.8821
No log	0.1511	84	0.7636	0.0276	0.7636	0.8738
No log	0.1547	86	0.7543	0.0211	0.7543	0.8685
No log	0.1583	88	0.7650	0.0211	0.7650	0.8746
No log	0.1619	90	0.7610	0.0315	0.7610	0.8724
No log	0.1655	92	0.7563	0.0545	0.7563	0.8696
No log	0.1691	94	0.7345	0.0752	0.7345	0.8570
No log	0.1727	96	0.7062	0.0482	0.7062	0.8403
No log	0.1763	98	0.6940	0.0607	0.6940	0.8331
No log	0.1799	100	0.6850	0.1263	0.6850	0.8276
No log	0.1835	102	0.6721	0.1847	0.6721	0.8198
No log	0.1871	104	0.6310	0.1614	0.6310	0.7944
No log	0.1906	106	0.6639	0.1379	0.6639	0.8148
No log	0.1942	108	0.7187	0.0482	0.7187	0.8477
No log	0.1978	110	0.7205	0.0545	0.7205	0.8488
No log	0.2014	112	0.6925	0.0752	0.6925	0.8322
No log	0.2050	114	0.6428	0.1523	0.6428	0.8018
No log	0.2086	116	0.6803	0.1956	0.6803	0.8248
No log	0.2122	118	0.8358	0.2060	0.8358	0.9142
No log	0.2158	120	0.8024	0.1910	0.8024	0.8958
No log	0.2194	122	0.6860	0.1485	0.6860	0.8282
No log	0.2230	124	0.7698	0.3251	0.7698	0.8774
No log	0.2266	126	0.7759	0.2757	0.7759	0.8809
No log	0.2302	128	0.7656	0.0816	0.7656	0.8750
No log	0.2338	130	0.8245	0.0669	0.8245	0.9080
No log	0.2374	132	0.7871	0.0276	0.7871	0.8872
No log	0.2410	134	0.7725	0.0632	0.7725	0.8789
No log	0.2446	136	0.8331	0.3619	0.8331	0.9127
No log	0.2482	138	0.8376	0.3843	0.8376	0.9152
No log	0.2518	140	0.7570	0.2959	0.7570	0.8701
No log	0.2554	142	0.7399	0.1223	0.7399	0.8601
No log	0.2590	144	0.7941	0.1317	0.7941	0.8911
No log	0.2626	146	0.7482	0.1031	0.7482	0.8650
No log	0.2662	148	0.7749	0.2552	0.7749	0.8803
No log	0.2698	150	0.8069	0.3062	0.8069	0.8983
No log	0.2734	152	0.7846	0.3029	0.7846	0.8858
No log	0.2770	154	0.7344	0.1233	0.7344	0.8570
No log	0.2806	156	0.6986	0.0963	0.6986	0.8358
No log	0.2842	158	0.6893	0.1146	0.6893	0.8302
No log	0.2878	160	0.7335	0.0920	0.7335	0.8564
No log	0.2914	162	0.7402	0.1235	0.7402	0.8604
No log	0.2950	164	0.6970	0.1985	0.6970	0.8348
No log	0.2986	166	0.6796	0.2769	0.6796	0.8243
No log	0.3022	168	0.6916	0.3134	0.6916	0.8316
No log	0.3058	170	0.6929	0.3103	0.6929	0.8324
No log	0.3094	172	0.6869	0.1730	0.6869	0.8288
No log	0.3129	174	0.6781	0.1893	0.6781	0.8235
No log	0.3165	176	0.6535	0.2586	0.6535	0.8084
No log	0.3201	178	0.6346	0.3058	0.6346	0.7966
No log	0.3237	180	0.6309	0.4594	0.6309	0.7943
No log	0.3273	182	0.5461	0.4749	0.5461	0.7390
No log	0.3309	184	0.5382	0.4133	0.5382	0.7336
No log	0.3345	186	0.5070	0.4923	0.5070	0.7120
No log	0.3381	188	0.5627	0.3936	0.5627	0.7502
No log	0.3417	190	0.5657	0.3840	0.5657	0.7522
No log	0.3453	192	0.5467	0.4253	0.5467	0.7394
No log	0.3489	194	0.6041	0.3030	0.6041	0.7772
No log	0.3525	196	0.6850	0.3490	0.6850	0.8276
No log	0.3561	198	0.7010	0.3101	0.7010	0.8373
No log	0.3597	200	0.6799	0.3000	0.6799	0.8246
No log	0.3633	202	0.7000	0.3561	0.7000	0.8367
No log	0.3669	204	0.7818	0.4005	0.7818	0.8842
No log	0.3705	206	0.7313	0.3978	0.7313	0.8552
No log	0.3741	208	0.7180	0.4096	0.7180	0.8474
No log	0.3777	210	0.7600	0.3988	0.7600	0.8718
No log	0.3813	212	0.6848	0.3741	0.6848	0.8275
No log	0.3849	214	0.6889	0.3646	0.6889	0.8300
No log	0.3885	216	0.6416	0.3438	0.6416	0.8010
No log	0.3921	218	0.5931	0.3915	0.5931	0.7701
No log	0.3957	220	0.5224	0.4856	0.5224	0.7227
No log	0.3993	222	0.5046	0.5463	0.5046	0.7103
No log	0.4029	224	0.4591	0.5556	0.4591	0.6775
No log	0.4065	226	0.4752	0.5876	0.4752	0.6893
No log	0.4101	228	0.5257	0.4543	0.5257	0.7251
No log	0.4137	230	0.5244	0.4575	0.5244	0.7241
No log	0.4173	232	0.4818	0.5786	0.4818	0.6941
No log	0.4209	234	0.5189	0.5849	0.5189	0.7204
No log	0.4245	236	0.4813	0.5275	0.4813	0.6938
No log	0.4281	238	0.6028	0.3307	0.6028	0.7764
No log	0.4317	240	0.6467	0.2987	0.6467	0.8042
No log	0.4353	242	0.5584	0.3361	0.5584	0.7473
No log	0.4388	244	0.6244	0.4608	0.6244	0.7902
No log	0.4424	246	0.7894	0.4471	0.7894	0.8885
No log	0.4460	248	0.7881	0.4192	0.7881	0.8878
No log	0.4496	250	0.6862	0.3685	0.6862	0.8284
No log	0.4532	252	0.7045	0.1154	0.7045	0.8394
No log	0.4568	254	0.7473	0.0864	0.7473	0.8644
No log	0.4604	256	0.7169	0.0897	0.7169	0.8467
No log	0.4640	258	0.7075	0.3036	0.7075	0.8411
No log	0.4676	260	0.7887	0.4051	0.7887	0.8881
No log	0.4712	262	0.8429	0.4179	0.8429	0.9181
No log	0.4748	264	0.7952	0.4091	0.7952	0.8917
No log	0.4784	266	0.6811	0.4205	0.6811	0.8253
No log	0.4820	268	0.6454	0.2699	0.6454	0.8034
No log	0.4856	270	0.6367	0.2986	0.6367	0.7979
No log	0.4892	272	0.6177	0.3480	0.6177	0.7860
No log	0.4928	274	0.6115	0.4405	0.6115	0.7820
No log	0.4964	276	0.6096	0.4644	0.6096	0.7807
No log	0.5	278	0.5711	0.4796	0.5711	0.7557
No log	0.5036	280	0.5587	0.4132	0.5587	0.7475
No log	0.5072	282	0.5634	0.3387	0.5634	0.7506
No log	0.5108	284	0.5565	0.4170	0.5565	0.7460
No log	0.5144	286	0.6402	0.4759	0.6402	0.8001
No log	0.5180	288	0.6352	0.4765	0.6352	0.7970
No log	0.5216	290	0.6495	0.4805	0.6495	0.8059
No log	0.5252	292	0.6934	0.4749	0.6934	0.8327
No log	0.5288	294	0.6484	0.4902	0.6484	0.8052
No log	0.5324	296	0.5866	0.4602	0.5866	0.7659
No log	0.5360	298	0.6042	0.5024	0.6042	0.7773
No log	0.5396	300	0.6232	0.5082	0.6232	0.7894
No log	0.5432	302	0.5771	0.5008	0.5771	0.7597
No log	0.5468	304	0.5323	0.4917	0.5323	0.7296
No log	0.5504	306	0.6424	0.5213	0.6424	0.8015
No log	0.5540	308	0.6106	0.5522	0.6106	0.7814
No log	0.5576	310	0.4591	0.5079	0.4591	0.6776
No log	0.5612	312	0.5330	0.4024	0.5330	0.7301
No log	0.5647	314	0.4793	0.4747	0.4793	0.6923
No log	0.5683	316	0.5157	0.5397	0.5157	0.7181
No log	0.5719	318	0.5899	0.5389	0.5899	0.7680
No log	0.5755	320	0.5330	0.4880	0.5330	0.7300
No log	0.5791	322	0.5489	0.3345	0.5489	0.7409
No log	0.5827	324	0.6229	0.2664	0.6229	0.7892
No log	0.5863	326	0.5954	0.2710	0.5954	0.7716
No log	0.5899	328	0.5167	0.4287	0.5167	0.7188
No log	0.5935	330	0.5505	0.5533	0.5505	0.7420
No log	0.5971	332	0.5735	0.5483	0.5735	0.7573
No log	0.6007	334	0.5038	0.5234	0.5038	0.7098
No log	0.6043	336	0.4864	0.4582	0.4864	0.6974
No log	0.6079	338	0.4993	0.3937	0.4993	0.7066
No log	0.6115	340	0.4913	0.5011	0.4913	0.7010
No log	0.6151	342	0.5813	0.5308	0.5813	0.7624
No log	0.6187	344	0.8252	0.4798	0.8252	0.9084
No log	0.6223	346	0.8634	0.4631	0.8634	0.9292
No log	0.6259	348	0.7054	0.4652	0.7054	0.8399
No log	0.6295	350	0.6510	0.4673	0.6510	0.8068
No log	0.6331	352	0.6432	0.3118	0.6432	0.8020
No log	0.6367	354	0.6380	0.3174	0.6380	0.7987
No log	0.6403	356	0.6533	0.4664	0.6533	0.8082
No log	0.6439	358	0.6395	0.5044	0.6395	0.7997
No log	0.6475	360	0.5614	0.5329	0.5614	0.7492
No log	0.6511	362	0.4792	0.5421	0.4792	0.6922
No log	0.6547	364	0.4966	0.5049	0.4966	0.7047
No log	0.6583	366	0.6160	0.4765	0.6160	0.7848
No log	0.6619	368	0.5361	0.5264	0.5361	0.7322
No log	0.6655	370	0.5172	0.5662	0.5172	0.7192
No log	0.6691	372	0.5109	0.6011	0.5109	0.7148
No log	0.6727	374	0.4915	0.5853	0.4915	0.7011
No log	0.6763	376	0.4997	0.5907	0.4997	0.7069
No log	0.6799	378	0.4970	0.5842	0.4970	0.7050
No log	0.6835	380	0.4774	0.5663	0.4774	0.6910
No log	0.6871	382	0.5446	0.5523	0.5446	0.7380
No log	0.6906	384	0.8005	0.5141	0.8005	0.8947
No log	0.6942	386	1.0151	0.4721	1.0151	1.0075
No log	0.6978	388	0.9355	0.4992	0.9355	0.9672
No log	0.7014	390	0.6928	0.5704	0.6928	0.8323
No log	0.7050	392	0.5456	0.5221	0.5456	0.7386
No log	0.7086	394	0.5168	0.5438	0.5168	0.7189
No log	0.7122	396	0.5689	0.5952	0.5689	0.7543
No log	0.7158	398	0.6042	0.6012	0.6042	0.7773
No log	0.7194	400	0.5451	0.5942	0.5451	0.7383
No log	0.7230	402	0.5226	0.5746	0.5226	0.7229
No log	0.7266	404	0.5523	0.5839	0.5523	0.7432
No log	0.7302	406	0.5664	0.6070	0.5664	0.7526
No log	0.7338	408	0.5193	0.5697	0.5193	0.7206
No log	0.7374	410	0.4819	0.5632	0.4819	0.6942
No log	0.7410	412	0.5501	0.5952	0.5501	0.7417
No log	0.7446	414	0.6738	0.5472	0.6738	0.8209
No log	0.7482	416	0.7628	0.4997	0.7628	0.8734
No log	0.7518	418	0.6396	0.4587	0.6396	0.7997
No log	0.7554	420	0.6449	0.3962	0.6449	0.8031
No log	0.7590	422	0.7491	0.4010	0.7491	0.8655
No log	0.7626	424	0.8024	0.4422	0.8024	0.8957
No log	0.7662	426	0.6955	0.4352	0.6955	0.8340
No log	0.7698	428	0.6283	0.3937	0.6283	0.7927
No log	0.7734	430	0.6394	0.3894	0.6394	0.7996
No log	0.7770	432	0.7091	0.4459	0.7091	0.8421
No log	0.7806	434	0.6753	0.4779	0.6753	0.8218
No log	0.7842	436	0.6884	0.5060	0.6884	0.8297
No log	0.7878	438	0.6413	0.5462	0.6413	0.8008
No log	0.7914	440	0.5410	0.5190	0.5410	0.7355
No log	0.7950	442	0.6145	0.5742	0.6145	0.7839
No log	0.7986	444	0.6359	0.5859	0.6359	0.7975
No log	0.8022	446	0.5164	0.5889	0.5164	0.7186
No log	0.8058	448	0.4705	0.5642	0.4705	0.6859
No log	0.8094	450	0.4687	0.5778	0.4687	0.6846
No log	0.8129	452	0.4606	0.5416	0.4606	0.6787
No log	0.8165	454	0.4819	0.5457	0.4819	0.6942
No log	0.8201	456	0.6241	0.6184	0.6241	0.7900
No log	0.8237	458	0.6341	0.5923	0.6341	0.7963
No log	0.8273	460	0.5501	0.5301	0.5501	0.7417
No log	0.8309	462	0.4963	0.5164	0.4963	0.7045
No log	0.8345	464	0.4645	0.4540	0.4645	0.6816
No log	0.8381	466	0.4500	0.4872	0.4500	0.6708
No log	0.8417	468	0.4891	0.5727	0.4891	0.6994
No log	0.8453	470	0.6804	0.6084	0.6804	0.8248
No log	0.8489	472	0.6144	0.5688	0.6144	0.7838
No log	0.8525	474	0.4893	0.5249	0.4893	0.6995
No log	0.8561	476	0.5002	0.5289	0.5002	0.7072
No log	0.8597	478	0.5681	0.5893	0.5681	0.7537
No log	0.8633	480	0.6175	0.5901	0.6175	0.7858
No log	0.8669	482	0.5372	0.5979	0.5372	0.7329
No log	0.8705	484	0.4826	0.5530	0.4826	0.6947
No log	0.8741	486	0.4863	0.4640	0.4863	0.6973
No log	0.8777	488	0.5404	0.5059	0.5404	0.7351
No log	0.8813	490	0.6827	0.5270	0.6827	0.8263
No log	0.8849	492	0.7943	0.5499	0.7943	0.8912
No log	0.8885	494	0.7908	0.5950	0.7908	0.8893
No log	0.8921	496	0.6065	0.5657	0.6065	0.7788
No log	0.8957	498	0.5626	0.5587	0.5626	0.7501
0.5246	0.8993	500	0.6509	0.5980	0.6509	0.8068
0.5246	0.9029	502	1.0265	0.6138	1.0265	1.0131
0.5246	0.9065	504	1.2379	0.6013	1.2379	1.1126
0.5246	0.9101	506	0.9988	0.5765	0.9988	0.9994
0.5246	0.9137	508	0.5723	0.5713	0.5723	0.7565
0.5246	0.9173	510	0.4707	0.5566	0.4707	0.6861
0.5246	0.9209	512	0.4884	0.5719	0.4884	0.6989
0.5246	0.9245	514	0.6348	0.5827	0.6348	0.7967

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1