ASAP_FineTuningBERT_AugV4_k2_task1_organization_fold3

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5996
• Qwk: 0.4731
• Mse: 0.5996
• Rmse: 0.7743

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0088	2	10.7575	0.0041	10.7575	3.2799
No log	0.0176	4	8.7057	0.0	8.7057	2.9505
No log	0.0264	6	7.4572	0.0	7.4572	2.7308
No log	0.0352	8	7.0573	0.0	7.0573	2.6566
No log	0.0441	10	6.3211	-0.0040	6.3211	2.5142
No log	0.0529	12	5.5200	0.0038	5.5200	2.3495
No log	0.0617	14	4.8921	0.0	4.8921	2.2118
No log	0.0705	16	4.2342	0.0	4.2342	2.0577
No log	0.0793	18	3.7482	0.0	3.7482	1.9360
No log	0.0881	20	3.2906	0.0	3.2906	1.8140
No log	0.0969	22	2.5288	0.0826	2.5288	1.5902
No log	0.1057	24	2.0924	0.0165	2.0924	1.4465
No log	0.1145	26	1.8888	0.0202	1.8888	1.3743
No log	0.1233	28	1.4025	0.0102	1.4025	1.1843
No log	0.1322	30	1.1132	0.0	1.1132	1.0551
No log	0.1410	32	1.1171	0.0	1.1171	1.0569
No log	0.1498	34	0.8951	0.1562	0.8951	0.9461
No log	0.1586	36	0.9322	0.0502	0.9322	0.9655
No log	0.1674	38	0.9141	0.0314	0.9141	0.9561
No log	0.1762	40	0.9527	0.0157	0.9527	0.9761
No log	0.1850	42	0.9087	0.0157	0.9087	0.9533
No log	0.1938	44	0.9428	0.0	0.9428	0.9710
No log	0.2026	46	0.9280	0.0	0.9280	0.9633
No log	0.2115	48	0.8205	0.0400	0.8205	0.9058
No log	0.2203	50	0.7610	0.1537	0.7610	0.8724
No log	0.2291	52	0.7446	0.1417	0.7446	0.8629
No log	0.2379	54	0.7796	0.0796	0.7796	0.8829
No log	0.2467	56	0.7218	0.1413	0.7218	0.8496
No log	0.2555	58	0.7390	0.4279	0.7390	0.8596
No log	0.2643	60	0.7607	0.4089	0.7607	0.8722
No log	0.2731	62	0.6752	0.2708	0.6752	0.8217
No log	0.2819	64	0.6826	0.2370	0.6826	0.8262
No log	0.2907	66	0.6473	0.3168	0.6473	0.8046
No log	0.2996	68	0.6352	0.3877	0.6352	0.7970
No log	0.3084	70	0.7201	0.3703	0.7201	0.8486
No log	0.3172	72	0.6861	0.3852	0.6861	0.8283
No log	0.3260	74	0.6175	0.4233	0.6175	0.7858
No log	0.3348	76	0.6220	0.4252	0.6220	0.7887
No log	0.3436	78	0.7262	0.3384	0.7262	0.8522
No log	0.3524	80	1.0444	0.1223	1.0444	1.0220
No log	0.3612	82	0.8628	0.2884	0.8628	0.9288
No log	0.3700	84	0.6388	0.3816	0.6388	0.7993
No log	0.3789	86	0.7641	0.4431	0.7641	0.8742
No log	0.3877	88	0.6734	0.3263	0.6734	0.8206
No log	0.3965	90	0.6962	0.3546	0.6962	0.8344
No log	0.4053	92	0.8563	0.2911	0.8563	0.9254
No log	0.4141	94	0.8467	0.3005	0.8467	0.9201
No log	0.4229	96	0.7195	0.3565	0.7195	0.8482
No log	0.4317	98	0.7062	0.2955	0.7062	0.8403
No log	0.4405	100	0.9805	0.3394	0.9805	0.9902
No log	0.4493	102	1.0243	0.3095	1.0243	1.0121
No log	0.4581	104	0.7704	0.4181	0.7704	0.8777
No log	0.4670	106	0.6498	0.3856	0.6498	0.8061
No log	0.4758	108	0.7065	0.3237	0.7065	0.8405
No log	0.4846	110	0.6437	0.3698	0.6437	0.8023
No log	0.4934	112	0.6392	0.4404	0.6392	0.7995
No log	0.5022	114	0.6720	0.4795	0.6720	0.8198
No log	0.5110	116	0.6697	0.4757	0.6697	0.8183
No log	0.5198	118	0.6395	0.4892	0.6395	0.7997
No log	0.5286	120	0.6049	0.4994	0.6049	0.7777
No log	0.5374	122	0.5916	0.4106	0.5916	0.7692
No log	0.5463	124	0.5838	0.4245	0.5838	0.7641
No log	0.5551	126	0.5733	0.5358	0.5733	0.7571
No log	0.5639	128	0.5864	0.4690	0.5864	0.7658
No log	0.5727	130	0.5843	0.4381	0.5843	0.7644
No log	0.5815	132	0.5917	0.4324	0.5917	0.7692
No log	0.5903	134	0.5748	0.4712	0.5748	0.7581
No log	0.5991	136	0.5504	0.4788	0.5504	0.7419
No log	0.6079	138	0.6251	0.5572	0.6251	0.7906
No log	0.6167	140	0.5970	0.5426	0.5970	0.7726
No log	0.6256	142	0.5324	0.5158	0.5324	0.7296
No log	0.6344	144	0.5528	0.5482	0.5528	0.7435
No log	0.6432	146	0.5301	0.5475	0.5301	0.7281
No log	0.6520	148	0.5348	0.5310	0.5348	0.7313
No log	0.6608	150	0.5742	0.5473	0.5742	0.7578
No log	0.6696	152	0.5437	0.5402	0.5437	0.7373
No log	0.6784	154	0.5193	0.5576	0.5193	0.7206
No log	0.6872	156	0.5587	0.5419	0.5587	0.7474
No log	0.6960	158	0.5128	0.5303	0.5128	0.7161
No log	0.7048	160	0.6063	0.5317	0.6063	0.7787
No log	0.7137	162	0.5554	0.4594	0.5554	0.7452
No log	0.7225	164	0.5989	0.4747	0.5989	0.7739
No log	0.7313	166	0.7395	0.4751	0.7395	0.8599
No log	0.7401	168	0.9604	0.4411	0.9604	0.9800
No log	0.7489	170	0.6509	0.4888	0.6509	0.8068
No log	0.7577	172	0.5281	0.5326	0.5281	0.7267
No log	0.7665	174	0.5441	0.5552	0.5441	0.7377
No log	0.7753	176	0.8051	0.5053	0.8051	0.8973
No log	0.7841	178	0.6114	0.5683	0.6114	0.7820
No log	0.7930	180	0.4983	0.5449	0.4983	0.7059
No log	0.8018	182	0.5086	0.5119	0.5086	0.7132
No log	0.8106	184	0.6254	0.5342	0.6254	0.7908
No log	0.8194	186	0.7434	0.4956	0.7434	0.8622
No log	0.8282	188	0.5628	0.5403	0.5628	0.7502
No log	0.8370	190	0.5586	0.5467	0.5586	0.7474
No log	0.8458	192	0.7230	0.5084	0.7230	0.8503
No log	0.8546	194	0.7209	0.5050	0.7209	0.8491
No log	0.8634	196	0.5204	0.5517	0.5204	0.7214
No log	0.8722	198	0.5303	0.5299	0.5303	0.7282
No log	0.8811	200	0.5228	0.5567	0.5228	0.7231
No log	0.8899	202	0.5231	0.5793	0.5231	0.7233
No log	0.8987	204	0.5271	0.6076	0.5271	0.7260
No log	0.9075	206	0.5466	0.5750	0.5466	0.7393
No log	0.9163	208	0.5473	0.5882	0.5473	0.7398
No log	0.9251	210	0.5555	0.5937	0.5555	0.7453
No log	0.9339	212	0.5761	0.5572	0.5761	0.7590
No log	0.9427	214	0.6675	0.5224	0.6675	0.8170
No log	0.9515	216	0.5736	0.5425	0.5736	0.7574
No log	0.9604	218	0.5292	0.5275	0.5292	0.7274
No log	0.9692	220	0.5143	0.5898	0.5143	0.7172
No log	0.9780	222	0.5725	0.6090	0.5725	0.7567
No log	0.9868	224	0.5493	0.6078	0.5493	0.7411
No log	0.9956	226	0.5717	0.5718	0.5717	0.7561
No log	1.0044	228	0.6262	0.5190	0.6262	0.7913
No log	1.0132	230	0.5341	0.5653	0.5341	0.7308
No log	1.0220	232	0.5142	0.5581	0.5142	0.7171
No log	1.0308	234	0.5804	0.5586	0.5804	0.7618
No log	1.0396	236	0.6713	0.5364	0.6713	0.8193
No log	1.0485	238	0.6149	0.5585	0.6149	0.7842
No log	1.0573	240	0.5149	0.5410	0.5149	0.7175
No log	1.0661	242	0.5139	0.5443	0.5139	0.7168
No log	1.0749	244	0.5893	0.5291	0.5893	0.7676
No log	1.0837	246	0.6355	0.5368	0.6355	0.7972
No log	1.0925	248	0.5284	0.5391	0.5284	0.7269
No log	1.1013	250	0.4937	0.5654	0.4937	0.7026
No log	1.1101	252	0.5272	0.5552	0.5272	0.7261
No log	1.1189	254	0.6055	0.5279	0.6055	0.7781
No log	1.1278	256	0.5617	0.5645	0.5617	0.7495
No log	1.1366	258	0.5464	0.5859	0.5464	0.7392
No log	1.1454	260	0.5377	0.5615	0.5377	0.7333
No log	1.1542	262	0.6162	0.5112	0.6162	0.7850
No log	1.1630	264	0.6363	0.5071	0.6363	0.7977
No log	1.1718	266	0.5361	0.5473	0.5361	0.7322
No log	1.1806	268	0.5101	0.5833	0.5101	0.7142
No log	1.1894	270	0.5046	0.5836	0.5046	0.7103
No log	1.1982	272	0.5501	0.5093	0.5501	0.7417
No log	1.2070	274	0.5420	0.5106	0.5420	0.7362
No log	1.2159	276	0.5558	0.5188	0.5558	0.7455
No log	1.2247	278	0.8331	0.4877	0.8331	0.9127
No log	1.2335	280	0.7898	0.4980	0.7898	0.8887
No log	1.2423	282	0.5302	0.5573	0.5302	0.7282
No log	1.2511	284	0.5717	0.5295	0.5717	0.7561
No log	1.2599	286	0.5424	0.5447	0.5424	0.7365
No log	1.2687	288	0.5401	0.5915	0.5401	0.7349
No log	1.2775	290	0.6184	0.5903	0.6184	0.7864
No log	1.2863	292	0.5038	0.6184	0.5038	0.7098
No log	1.2952	294	0.5869	0.5351	0.5869	0.7661
No log	1.3040	296	0.5571	0.5633	0.5571	0.7464
No log	1.3128	298	0.4914	0.6002	0.4914	0.7010
No log	1.3216	300	0.5512	0.6160	0.5512	0.7424
No log	1.3304	302	0.5523	0.5798	0.5523	0.7432
No log	1.3392	304	0.5151	0.5621	0.5151	0.7177
No log	1.3480	306	0.5449	0.5669	0.5449	0.7382
No log	1.3568	308	0.7565	0.5240	0.7565	0.8698
No log	1.3656	310	0.7852	0.5118	0.7852	0.8861
No log	1.3744	312	0.5708	0.5619	0.5708	0.7555
No log	1.3833	314	0.5303	0.5583	0.5303	0.7282
No log	1.3921	316	0.5364	0.5638	0.5364	0.7324
No log	1.4009	318	0.5372	0.5817	0.5372	0.7329
No log	1.4097	320	0.6285	0.5586	0.6285	0.7928
No log	1.4185	322	0.6249	0.5692	0.6249	0.7905
No log	1.4273	324	0.5009	0.6335	0.5009	0.7078
No log	1.4361	326	0.5085	0.6082	0.5085	0.7131
No log	1.4449	328	0.5376	0.6085	0.5376	0.7332
No log	1.4537	330	0.5855	0.6298	0.5855	0.7652
No log	1.4626	332	0.8174	0.5724	0.8174	0.9041
No log	1.4714	334	0.7242	0.5936	0.7242	0.8510
No log	1.4802	336	0.5442	0.6170	0.5442	0.7377
No log	1.4890	338	0.5284	0.6217	0.5284	0.7269
No log	1.4978	340	0.5649	0.6171	0.5649	0.7516
No log	1.5066	342	0.7080	0.5879	0.7080	0.8414
No log	1.5154	344	0.7205	0.5762	0.7205	0.8488
No log	1.5242	346	0.5506	0.6246	0.5506	0.7420
No log	1.5330	348	0.4857	0.6328	0.4857	0.6969
No log	1.5419	350	0.5899	0.5509	0.5899	0.7680
No log	1.5507	352	0.5578	0.5970	0.5578	0.7468
No log	1.5595	354	0.5175	0.6301	0.5175	0.7194
No log	1.5683	356	0.4907	0.6268	0.4907	0.7005
No log	1.5771	358	0.5065	0.6113	0.5065	0.7117
No log	1.5859	360	0.5313	0.6264	0.5313	0.7289
No log	1.5947	362	0.6920	0.5654	0.6920	0.8319
No log	1.6035	364	0.6481	0.5727	0.6481	0.8051
No log	1.6123	366	0.6688	0.5774	0.6688	0.8178
No log	1.6211	368	0.7260	0.5775	0.7260	0.8520
No log	1.6300	370	0.7567	0.5580	0.7567	0.8699
No log	1.6388	372	0.7369	0.5463	0.7369	0.8584
No log	1.6476	374	0.5361	0.5817	0.5361	0.7322
No log	1.6564	376	0.5015	0.5803	0.5015	0.7082
No log	1.6652	378	0.5266	0.6138	0.5266	0.7257
No log	1.6740	380	0.5512	0.6253	0.5512	0.7425
No log	1.6828	382	0.5319	0.6166	0.5319	0.7293
No log	1.6916	384	0.7083	0.5478	0.7083	0.8416
No log	1.7004	386	0.7305	0.5308	0.7305	0.8547
No log	1.7093	388	0.5772	0.5984	0.5772	0.7597
No log	1.7181	390	0.5438	0.6212	0.5438	0.7374
No log	1.7269	392	0.5715	0.6048	0.5715	0.7560
No log	1.7357	394	0.7329	0.5292	0.7329	0.8561
No log	1.7445	396	0.6823	0.5509	0.6823	0.8260
No log	1.7533	398	0.5234	0.6150	0.5234	0.7235
No log	1.7621	400	0.6808	0.6018	0.6808	0.8251
No log	1.7709	402	0.7031	0.5891	0.7031	0.8385
No log	1.7797	404	0.5385	0.6090	0.5385	0.7338
No log	1.7885	406	0.5331	0.5587	0.5331	0.7301
No log	1.7974	408	0.5381	0.5684	0.5381	0.7335
No log	1.8062	410	0.5074	0.5873	0.5074	0.7123
No log	1.8150	412	0.6589	0.5705	0.6589	0.8117
No log	1.8238	414	0.8151	0.5155	0.8151	0.9028
No log	1.8326	416	0.6964	0.5568	0.6964	0.8345
No log	1.8414	418	0.5469	0.5712	0.5469	0.7396
No log	1.8502	420	0.5857	0.5454	0.5857	0.7653
No log	1.8590	422	0.5661	0.5743	0.5661	0.7524
No log	1.8678	424	0.5935	0.6020	0.5935	0.7704
No log	1.8767	426	0.7216	0.5810	0.7216	0.8495
No log	1.8855	428	0.6764	0.5962	0.6764	0.8225
No log	1.8943	430	0.5707	0.6161	0.5707	0.7555
No log	1.9031	432	0.4994	0.6015	0.4994	0.7067
No log	1.9119	434	0.4874	0.6109	0.4874	0.6982
No log	1.9207	436	0.5391	0.6180	0.5391	0.7342
No log	1.9295	438	0.5438	0.5959	0.5438	0.7374
No log	1.9383	440	0.5303	0.6148	0.5303	0.7282
No log	1.9471	442	0.4777	0.5936	0.4777	0.6911
No log	1.9559	444	0.4790	0.6045	0.4790	0.6921
No log	1.9648	446	0.4914	0.6016	0.4914	0.7010
No log	1.9736	448	0.5240	0.6223	0.5240	0.7238
No log	1.9824	450	0.5734	0.6098	0.5734	0.7572
No log	1.9912	452	0.5203	0.6289	0.5203	0.7213
No log	2.0	454	0.4952	0.6242	0.4952	0.7037
No log	2.0088	456	0.4962	0.6083	0.4962	0.7044
No log	2.0176	458	0.4914	0.6094	0.4914	0.7010
No log	2.0264	460	0.5064	0.6292	0.5064	0.7116
No log	2.0352	462	0.5052	0.6408	0.5052	0.7108
No log	2.0441	464	0.4990	0.6470	0.4990	0.7064
No log	2.0529	466	0.4956	0.6442	0.4956	0.7040
No log	2.0617	468	0.4971	0.6396	0.4971	0.7050
No log	2.0705	470	0.4934	0.6262	0.4934	0.7024
No log	2.0793	472	0.4943	0.6097	0.4943	0.7030
No log	2.0881	474	0.5285	0.6131	0.5285	0.7270
No log	2.0969	476	0.6064	0.5735	0.6064	0.7787
No log	2.1057	478	0.5500	0.6028	0.5500	0.7416
No log	2.1145	480	0.5568	0.5896	0.5568	0.7462
No log	2.1233	482	0.5693	0.5749	0.5693	0.7545
No log	2.1322	484	0.6665	0.5677	0.6665	0.8164
No log	2.1410	486	0.6584	0.5816	0.6584	0.8114
No log	2.1498	488	0.5333	0.5943	0.5333	0.7303
No log	2.1586	490	0.5247	0.6143	0.5247	0.7244
No log	2.1674	492	0.5204	0.6150	0.5204	0.7214
No log	2.1762	494	0.5219	0.6079	0.5219	0.7224
No log	2.1850	496	0.5789	0.5819	0.5789	0.7609
No log	2.1938	498	0.5580	0.5927	0.5580	0.7470
1.011	2.2026	500	0.5141	0.6144	0.5141	0.7170
1.011	2.2115	502	0.6653	0.5662	0.6653	0.8157
1.011	2.2203	504	0.6232	0.5517	0.6232	0.7894
1.011	2.2291	506	0.6065	0.4404	0.6065	0.7788
1.011	2.2379	508	0.6582	0.3892	0.6582	0.8113
1.011	2.2467	510	0.5996	0.4731	0.5996	0.7743

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1