ASAP_FineTuningBERT_AugV4_k20_task1_organization_fold0

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7471
• Qwk: 0.3202
• Mse: 0.7471
• Rmse: 0.8643

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0010	2	9.7954	0.0036	9.7954	3.1298
No log	0.0021	4	8.3631	0.0	8.3631	2.8919
No log	0.0031	6	7.3743	0.0	7.3743	2.7156
No log	0.0041	8	6.7388	0.0	6.7388	2.5959
No log	0.0052	10	5.9411	0.0091	5.9411	2.4374
No log	0.0062	12	5.1503	0.0112	5.1503	2.2694
No log	0.0072	14	4.3682	0.0115	4.3682	2.0900
No log	0.0083	16	3.6330	0.0039	3.6330	1.9060
No log	0.0093	18	2.8966	0.0	2.8966	1.7019
No log	0.0103	20	2.2700	0.0731	2.2700	1.5066
No log	0.0114	22	1.7536	0.0382	1.7536	1.3242
No log	0.0124	24	1.3641	0.0316	1.3641	1.1679
No log	0.0135	26	1.0979	0.0316	1.0979	1.0478
No log	0.0145	28	0.8856	0.0487	0.8856	0.9411
No log	0.0155	30	0.8039	0.1397	0.8039	0.8966
No log	0.0166	32	0.7668	0.1076	0.7668	0.8757
No log	0.0176	34	0.7403	0.1169	0.7403	0.8604
No log	0.0186	36	0.8144	0.0798	0.8144	0.9025
No log	0.0197	38	0.9480	0.0521	0.9480	0.9736
No log	0.0207	40	0.9425	0.0174	0.9425	0.9708
No log	0.0217	42	1.0306	0.0521	1.0306	1.0152
No log	0.0228	44	1.0714	0.0348	1.0714	1.0351
No log	0.0238	46	0.9639	0.0521	0.9639	0.9818
No log	0.0248	48	0.9735	0.0521	0.9735	0.9867
No log	0.0259	50	0.9496	0.0521	0.9496	0.9745
No log	0.0269	52	0.8456	0.0521	0.8456	0.9196
No log	0.0279	54	0.8318	0.0521	0.8318	0.9120
No log	0.0290	56	0.7742	0.0803	0.7742	0.8799
No log	0.0300	58	0.8688	0.0521	0.8688	0.9321
No log	0.0310	60	1.1012	0.0348	1.1012	1.0494
No log	0.0321	62	1.2316	0.0889	1.2316	1.1098
No log	0.0331	64	1.1422	0.0125	1.1422	1.0688
No log	0.0341	66	1.0330	0.0174	1.0330	1.0164
No log	0.0352	68	1.1091	0.0174	1.1091	1.0531
No log	0.0362	70	1.0762	0.0174	1.0762	1.0374
No log	0.0372	72	1.0341	0.0174	1.0341	1.0169
No log	0.0383	74	0.9423	0.0174	0.9423	0.9707
No log	0.0393	76	0.9138	0.0174	0.9138	0.9559
No log	0.0404	78	0.9387	0.0174	0.9387	0.9689
No log	0.0414	80	0.9830	0.0174	0.9830	0.9914
No log	0.0424	82	0.9575	0.0174	0.9575	0.9785
No log	0.0435	84	0.8932	0.0174	0.8932	0.9451
No log	0.0445	86	0.8650	0.0174	0.8650	0.9301
No log	0.0455	88	0.8687	0.0	0.8687	0.9320
No log	0.0466	90	0.8942	0.0	0.8942	0.9456
No log	0.0476	92	1.0163	0.0174	1.0163	1.0081
No log	0.0486	94	1.1586	0.0174	1.1586	1.0764
No log	0.0497	96	1.0872	0.0174	1.0872	1.0427
No log	0.0507	98	0.9913	0.0174	0.9913	0.9957
No log	0.0517	100	0.9341	0.0174	0.9341	0.9665
No log	0.0528	102	0.9498	0.0174	0.9498	0.9746
No log	0.0538	104	0.9958	0.0174	0.9958	0.9979
No log	0.0548	106	1.0615	0.0	1.0615	1.0303
No log	0.0559	108	1.2641	0.0765	1.2641	1.1243
No log	0.0569	110	1.3163	0.0486	1.3163	1.1473
No log	0.0579	112	1.2238	0.0274	1.2238	1.1063
No log	0.0590	114	1.0506	-0.0662	1.0506	1.0250
No log	0.0600	116	1.0833	0.0348	1.0833	1.0408
No log	0.0610	118	1.1068	0.1395	1.1068	1.0521
No log	0.0621	120	1.1440	0.1508	1.1440	1.0696
No log	0.0631	122	1.3295	0.0784	1.3295	1.1530
No log	0.0641	124	1.5560	0.0434	1.5560	1.2474
No log	0.0652	126	1.4934	0.0448	1.4934	1.2220
No log	0.0662	128	1.2341	-0.0215	1.2341	1.1109
No log	0.0673	130	1.1780	-0.0769	1.1780	1.0853
No log	0.0683	132	1.0621	-0.0635	1.0621	1.0306
No log	0.0693	134	1.2510	0.0376	1.2510	1.1185
No log	0.0704	136	1.3927	0.0660	1.3927	1.1801
No log	0.0714	138	1.2321	0.0626	1.2321	1.1100
No log	0.0724	140	1.1206	0.0067	1.1206	1.0586
No log	0.0735	142	1.1694	0.0293	1.1694	1.0814
No log	0.0745	144	1.4817	0.0758	1.4817	1.2173
No log	0.0755	146	1.6317	0.0517	1.6317	1.2774
No log	0.0766	148	1.3862	0.1009	1.3862	1.1774
No log	0.0776	150	1.0835	0.0368	1.0835	1.0409
No log	0.0786	152	1.0563	0.0130	1.0563	1.0278
No log	0.0797	154	1.1515	0.0780	1.1515	1.0731
No log	0.0807	156	1.1422	0.0720	1.1422	1.0687
No log	0.0817	158	0.9683	-0.0166	0.9683	0.9840
No log	0.0828	160	0.9556	-0.0043	0.9556	0.9776
No log	0.0838	162	1.0944	0.0832	1.0944	1.0461
No log	0.0848	164	1.1548	0.1210	1.1548	1.0746
No log	0.0859	166	1.2407	0.1048	1.2407	1.1139
No log	0.0869	168	1.0875	0.1465	1.0875	1.0428
No log	0.0879	170	0.9771	0.0810	0.9771	0.9885
No log	0.0890	172	0.9035	0.0195	0.9035	0.9505
No log	0.0900	174	0.8713	0.0020	0.8713	0.9334
No log	0.0911	176	0.8797	0.0494	0.8797	0.9379
No log	0.0921	178	0.9793	0.1100	0.9793	0.9896
No log	0.0931	180	1.0679	0.1192	1.0679	1.0334
No log	0.0942	182	0.9230	0.1178	0.9230	0.9608
No log	0.0952	184	0.8105	0.1313	0.8105	0.9003
No log	0.0962	186	0.8036	0.1472	0.8036	0.8964
No log	0.0973	188	0.9082	0.1735	0.9082	0.9530
No log	0.0983	190	0.8943	0.2192	0.8943	0.9457
No log	0.0993	192	0.7569	0.1883	0.7569	0.8700
No log	0.1004	194	0.7473	0.2241	0.7473	0.8645
No log	0.1014	196	0.8202	0.2069	0.8202	0.9056
No log	0.1024	198	0.8107	0.2421	0.8107	0.9004
No log	0.1035	200	0.7626	0.2743	0.7626	0.8733
No log	0.1045	202	0.7869	0.2694	0.7869	0.8871
No log	0.1055	204	0.7625	0.3038	0.7625	0.8732
No log	0.1066	206	0.7676	0.2933	0.7676	0.8761
No log	0.1076	208	0.8769	0.3049	0.8769	0.9365
No log	0.1086	210	1.1860	0.2348	1.1860	1.0890
No log	0.1097	212	0.9754	0.2711	0.9754	0.9876
No log	0.1107	214	0.7538	0.1399	0.7538	0.8682
No log	0.1117	216	0.7429	0.2310	0.7429	0.8619
No log	0.1128	218	0.7348	0.2103	0.7348	0.8572
No log	0.1138	220	0.7408	0.1761	0.7408	0.8607
No log	0.1148	222	0.7553	0.2087	0.7553	0.8691
No log	0.1159	224	0.7812	0.2105	0.7812	0.8839
No log	0.1169	226	0.7438	0.2248	0.7438	0.8625
No log	0.1180	228	0.7189	0.2493	0.7189	0.8479
No log	0.1190	230	0.7216	0.2706	0.7216	0.8495
No log	0.1200	232	0.7937	0.3058	0.7937	0.8909
No log	0.1211	234	0.9452	0.3024	0.9452	0.9722
No log	0.1221	236	0.7744	0.3336	0.7744	0.8800
No log	0.1231	238	0.6752	0.3231	0.6752	0.8217
No log	0.1242	240	0.6820	0.3169	0.6820	0.8258
No log	0.1252	242	0.8566	0.2806	0.8566	0.9255
No log	0.1262	244	0.9518	0.2937	0.9518	0.9756
No log	0.1273	246	0.7580	0.2388	0.7580	0.8706
No log	0.1283	248	0.6981	0.2560	0.6981	0.8355
No log	0.1293	250	0.7067	0.2847	0.7067	0.8406
No log	0.1304	252	0.7251	0.2445	0.7251	0.8515
No log	0.1314	254	0.9206	0.2761	0.9206	0.9595
No log	0.1324	256	0.8753	0.2917	0.8753	0.9356
No log	0.1335	258	0.7137	0.3113	0.7137	0.8448
No log	0.1345	260	0.7175	0.2924	0.7175	0.8471
No log	0.1355	262	0.7467	0.3359	0.7467	0.8641
No log	0.1366	264	0.7938	0.3454	0.7938	0.8910
No log	0.1376	266	0.7441	0.3527	0.7441	0.8626
No log	0.1386	268	0.7300	0.2999	0.7300	0.8544
No log	0.1397	270	0.8558	0.2385	0.8558	0.9251
No log	0.1407	272	0.7411	0.3219	0.7411	0.8609
No log	0.1417	274	0.8754	0.3482	0.8754	0.9356
No log	0.1428	276	1.1164	0.2801	1.1164	1.0566
No log	0.1438	278	0.9342	0.3173	0.9342	0.9665
No log	0.1449	280	0.7253	0.3472	0.7253	0.8516
No log	0.1459	282	0.8811	0.2255	0.8811	0.9387
No log	0.1469	284	0.7957	0.2833	0.7957	0.8920
No log	0.1480	286	0.7903	0.3179	0.7903	0.8890
No log	0.1490	288	0.9706	0.2569	0.9706	0.9852
No log	0.1500	290	0.8836	0.3067	0.8836	0.9400
No log	0.1511	292	0.8088	0.2806	0.8088	0.8993
No log	0.1521	294	0.7588	0.3108	0.7588	0.8711
No log	0.1531	296	0.7357	0.3417	0.7357	0.8577
No log	0.1542	298	0.7188	0.3215	0.7188	0.8478
No log	0.1552	300	0.7483	0.3667	0.7483	0.8650
No log	0.1562	302	0.7399	0.3482	0.7399	0.8602
No log	0.1573	304	0.7445	0.3518	0.7445	0.8628
No log	0.1583	306	0.7841	0.3450	0.7841	0.8855
No log	0.1593	308	0.7984	0.3645	0.7984	0.8935
No log	0.1604	310	0.8229	0.3923	0.8229	0.9072
No log	0.1614	312	0.8433	0.3608	0.8433	0.9183
No log	0.1624	314	0.7478	0.3838	0.7478	0.8648
No log	0.1635	316	0.7100	0.3853	0.7100	0.8426
No log	0.1645	318	0.7199	0.4001	0.7199	0.8485
No log	0.1655	320	0.7937	0.3730	0.7937	0.8909
No log	0.1666	322	0.7828	0.3816	0.7828	0.8848
No log	0.1676	324	0.7007	0.3972	0.7007	0.8371
No log	0.1686	326	0.6736	0.3835	0.6736	0.8207
No log	0.1697	328	0.6816	0.3940	0.6816	0.8256
No log	0.1707	330	0.6983	0.3715	0.6983	0.8356
No log	0.1718	332	0.9216	0.3350	0.9216	0.9600
No log	0.1728	334	1.0408	0.2947	1.0408	1.0202
No log	0.1738	336	0.7844	0.3626	0.7844	0.8856
No log	0.1749	338	0.7415	0.3490	0.7415	0.8611
No log	0.1759	340	0.7780	0.3401	0.7780	0.8821
No log	0.1769	342	0.7321	0.3632	0.7321	0.8556
No log	0.1780	344	0.8016	0.3291	0.8016	0.8953
No log	0.1790	346	1.1327	0.2877	1.1327	1.0643
No log	0.1800	348	1.1354	0.2802	1.1354	1.0655
No log	0.1811	350	0.8213	0.3097	0.8213	0.9063
No log	0.1821	352	0.7472	0.3129	0.7472	0.8644
No log	0.1831	354	0.7565	0.3063	0.7565	0.8698
No log	0.1842	356	0.7878	0.2805	0.7878	0.8876
No log	0.1852	358	0.8235	0.2782	0.8235	0.9074
No log	0.1862	360	0.7179	0.2886	0.7179	0.8473
No log	0.1873	362	0.7026	0.3096	0.7026	0.8382
No log	0.1883	364	0.7873	0.3480	0.7873	0.8873
No log	0.1893	366	0.8004	0.3643	0.8004	0.8946
No log	0.1904	368	0.7347	0.3733	0.7347	0.8571
No log	0.1914	370	0.7637	0.3797	0.7637	0.8739
No log	0.1924	372	0.8092	0.3456	0.8092	0.8995
No log	0.1935	374	0.8593	0.3597	0.8593	0.9270
No log	0.1945	376	0.8224	0.3620	0.8224	0.9069
No log	0.1956	378	0.7218	0.3501	0.7218	0.8496
No log	0.1966	380	0.7180	0.3351	0.7180	0.8474
No log	0.1976	382	0.7616	0.3101	0.7616	0.8727
No log	0.1987	384	0.7351	0.2989	0.7351	0.8574
No log	0.1997	386	0.7151	0.2641	0.7151	0.8456
No log	0.2007	388	0.7182	0.2387	0.7182	0.8475
No log	0.2018	390	0.7088	0.2315	0.7088	0.8419
No log	0.2028	392	0.7102	0.2523	0.7102	0.8427
No log	0.2038	394	0.7253	0.2391	0.7253	0.8516
No log	0.2049	396	0.7293	0.2587	0.7293	0.8540
No log	0.2059	398	0.7406	0.2784	0.7406	0.8606
No log	0.2069	400	0.7449	0.3044	0.7449	0.8631
No log	0.2080	402	0.8446	0.3093	0.8446	0.9190
No log	0.2090	404	0.8958	0.3083	0.8958	0.9464
No log	0.2100	406	0.7723	0.3101	0.7723	0.8788
No log	0.2111	408	0.8678	0.2510	0.8678	0.9315
No log	0.2121	410	0.8203	0.2545	0.8203	0.9057
No log	0.2131	412	0.8371	0.3424	0.8371	0.9149
No log	0.2142	414	1.2717	0.2287	1.2717	1.1277
No log	0.2152	416	1.4281	0.1817	1.4281	1.1950
No log	0.2162	418	1.1060	0.2403	1.1060	1.0517
No log	0.2173	420	0.8219	0.2580	0.8219	0.9066
No log	0.2183	422	0.8017	0.2465	0.8017	0.8954
No log	0.2193	424	0.8119	0.2458	0.8119	0.9011
No log	0.2204	426	0.8225	0.2623	0.8225	0.9069
No log	0.2214	428	0.8040	0.2592	0.8040	0.8967
No log	0.2225	430	0.7925	0.2800	0.7925	0.8902
No log	0.2235	432	0.8093	0.2396	0.8093	0.8996
No log	0.2245	434	0.7996	0.2501	0.7996	0.8942
No log	0.2256	436	0.8414	0.2673	0.8414	0.9173
No log	0.2266	438	0.9049	0.3039	0.9049	0.9513
No log	0.2276	440	0.8153	0.2812	0.8153	0.9029
No log	0.2287	442	0.7411	0.2578	0.7411	0.8609
No log	0.2297	444	0.7523	0.2627	0.7523	0.8674
No log	0.2307	446	0.8608	0.3341	0.8608	0.9278
No log	0.2318	448	0.8527	0.3278	0.8527	0.9234
No log	0.2328	450	0.8261	0.3422	0.8261	0.9089
No log	0.2338	452	0.8310	0.3462	0.8310	0.9116
No log	0.2349	454	0.9097	0.3133	0.9097	0.9538
No log	0.2359	456	1.0062	0.2746	1.0062	1.0031
No log	0.2369	458	0.8932	0.2714	0.8932	0.9451
No log	0.2380	460	0.8586	0.2752	0.8586	0.9266
No log	0.2390	462	0.9816	0.2650	0.9816	0.9908
No log	0.2400	464	1.0321	0.2475	1.0321	1.0159
No log	0.2411	466	0.8502	0.2855	0.8502	0.9220
No log	0.2421	468	0.7734	0.2614	0.7734	0.8794
No log	0.2431	470	0.7965	0.2712	0.7965	0.8925
No log	0.2442	472	1.0430	0.2608	1.0430	1.0213
No log	0.2452	474	1.1130	0.2589	1.1130	1.0550
No log	0.2462	476	0.8816	0.3026	0.8816	0.9389
No log	0.2473	478	0.7499	0.2898	0.7499	0.8660
No log	0.2483	480	0.7460	0.3100	0.7460	0.8637
No log	0.2494	482	0.9395	0.3310	0.9395	0.9693
No log	0.2504	484	1.0006	0.3109	1.0006	1.0003
No log	0.2514	486	0.7745	0.3655	0.7745	0.8800
No log	0.2525	488	0.7455	0.3805	0.7455	0.8634
No log	0.2535	490	0.9072	0.3730	0.9072	0.9525
No log	0.2545	492	0.9415	0.3560	0.9415	0.9703
No log	0.2556	494	0.9006	0.3533	0.9006	0.9490
No log	0.2566	496	0.8500	0.3574	0.8500	0.9220
No log	0.2576	498	0.8125	0.3473	0.8125	0.9014
1.0184	0.2587	500	0.7906	0.3470	0.7906	0.8892
1.0184	0.2597	502	0.9147	0.3535	0.9147	0.9564
1.0184	0.2607	504	0.8699	0.3640	0.8699	0.9327
1.0184	0.2618	506	0.9151	0.3576	0.9151	0.9566
1.0184	0.2628	508	0.8358	0.3587	0.8358	0.9142
1.0184	0.2638	510	0.7576	0.3512	0.7576	0.8704
1.0184	0.2649	512	0.7185	0.3932	0.7185	0.8476
1.0184	0.2659	514	0.8014	0.3704	0.8014	0.8952
1.0184	0.2669	516	1.1175	0.3117	1.1175	1.0571
1.0184	0.2680	518	1.0329	0.3313	1.0329	1.0163
1.0184	0.2690	520	0.8798	0.3483	0.8798	0.9380
1.0184	0.2700	522	0.8179	0.3534	0.8179	0.9044
1.0184	0.2711	524	0.7114	0.3866	0.7114	0.8434
1.0184	0.2721	526	0.6985	0.4031	0.6985	0.8358
1.0184	0.2732	528	0.7827	0.3823	0.7827	0.8847
1.0184	0.2742	530	0.8529	0.3642	0.8529	0.9235
1.0184	0.2752	532	0.7811	0.3802	0.7811	0.8838
1.0184	0.2763	534	0.7194	0.3915	0.7194	0.8482
1.0184	0.2773	536	0.7506	0.3675	0.7506	0.8664
1.0184	0.2783	538	0.9124	0.3412	0.9124	0.9552
1.0184	0.2794	540	0.8486	0.3451	0.8486	0.9212
1.0184	0.2804	542	0.6798	0.3388	0.6798	0.8245
1.0184	0.2814	544	0.6569	0.3701	0.6569	0.8105
1.0184	0.2825	546	0.6957	0.3663	0.6957	0.8341
1.0184	0.2835	548	0.7381	0.3901	0.7381	0.8592
1.0184	0.2845	550	0.7479	0.4061	0.7479	0.8648
1.0184	0.2856	552	0.7200	0.4472	0.7200	0.8485
1.0184	0.2866	554	0.7171	0.4380	0.7171	0.8468
1.0184	0.2876	556	0.6997	0.4167	0.6997	0.8365
1.0184	0.2887	558	0.7954	0.3862	0.7954	0.8918
1.0184	0.2897	560	0.8714	0.3546	0.8714	0.9335
1.0184	0.2907	562	0.8037	0.3744	0.8037	0.8965
1.0184	0.2918	564	0.7325	0.3620	0.7325	0.8559
1.0184	0.2928	566	0.8043	0.3619	0.8043	0.8968
1.0184	0.2938	568	0.7846	0.3742	0.7846	0.8858
1.0184	0.2949	570	0.8479	0.3522	0.8479	0.9208
1.0184	0.2959	572	0.8521	0.3567	0.8521	0.9231
1.0184	0.2969	574	0.9080	0.3399	0.9080	0.9529
1.0184	0.2980	576	0.8414	0.3485	0.8414	0.9173
1.0184	0.2990	578	0.8616	0.3287	0.8616	0.9282
1.0184	0.3001	580	1.1011	0.3019	1.1011	1.0493
1.0184	0.3011	582	1.1102	0.2860	1.1102	1.0537
1.0184	0.3021	584	0.8175	0.3162	0.8175	0.9042
1.0184	0.3032	586	0.7531	0.3515	0.7531	0.8678
1.0184	0.3042	588	0.9002	0.3159	0.9002	0.9488
1.0184	0.3052	590	1.0100	0.3159	1.0100	1.0050
1.0184	0.3063	592	0.8297	0.3360	0.8297	0.9109
1.0184	0.3073	594	0.8095	0.3489	0.8095	0.8997
1.0184	0.3083	596	0.9846	0.3464	0.9846	0.9923
1.0184	0.3094	598	1.0127	0.3376	1.0127	1.0063
1.0184	0.3104	600	0.7477	0.3767	0.7477	0.8647
1.0184	0.3114	602	0.6995	0.4031	0.6995	0.8363
1.0184	0.3125	604	0.7403	0.3778	0.7403	0.8604
1.0184	0.3135	606	0.9572	0.3479	0.9572	0.9784
1.0184	0.3145	608	0.8813	0.3570	0.8813	0.9388
1.0184	0.3156	610	0.6899	0.3745	0.6899	0.8306
1.0184	0.3166	612	0.7165	0.3484	0.7165	0.8464
1.0184	0.3176	614	0.7109	0.3477	0.7109	0.8432
1.0184	0.3187	616	0.8166	0.3379	0.8166	0.9037
1.0184	0.3197	618	1.1536	0.2751	1.1536	1.0741
1.0184	0.3207	620	1.1066	0.2700	1.1066	1.0519
1.0184	0.3218	622	0.8176	0.3333	0.8176	0.9042
1.0184	0.3228	624	0.7471	0.3202	0.7471	0.8643

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1