ASAP_FineTuningBERT_Aug_k10_task1_organization_fold3

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5202
• Qwk: 0.6755
• Mse: 0.5202
• Rmse: 0.7213

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0112	2	10.6744	0.0	10.6744	3.2672
No log	0.0223	4	8.8042	0.0141	8.8042	2.9672
No log	0.0335	6	7.1198	0.0076	7.1198	2.6683
No log	0.0447	8	5.6084	0.0	5.6084	2.3682
No log	0.0559	10	4.3365	0.0042	4.3365	2.0824
No log	0.0670	12	3.3034	0.0218	3.3034	1.8175
No log	0.0782	14	2.4653	0.0076	2.4653	1.5701
No log	0.0894	16	1.9103	0.0	1.9103	1.3821
No log	0.1006	18	1.4798	0.0517	1.4798	1.2165
No log	0.1117	20	1.1226	0.0524	1.1226	1.0595
No log	0.1229	22	0.9826	0.0202	0.9826	0.9913
No log	0.1341	24	0.8766	0.0202	0.8766	0.9363
No log	0.1453	26	0.8313	0.0102	0.8313	0.9118
No log	0.1564	28	0.8141	0.0202	0.8141	0.9023
No log	0.1676	30	0.8120	0.0202	0.8120	0.9011
No log	0.1788	32	0.8671	0.0202	0.8671	0.9312
No log	0.1899	34	0.7955	0.0202	0.7955	0.8919
No log	0.2011	36	0.8132	0.2598	0.8132	0.9018
No log	0.2123	38	0.7759	0.0248	0.7759	0.8808
No log	0.2235	40	0.7680	0.0302	0.7680	0.8763
No log	0.2346	42	0.7292	0.0547	0.7292	0.8539
No log	0.2458	44	0.7015	0.1843	0.7015	0.8375
No log	0.2570	46	0.7496	0.3849	0.7496	0.8658
No log	0.2682	48	0.7177	0.0536	0.7177	0.8472
No log	0.2793	50	0.7079	0.0598	0.7079	0.8414
No log	0.2905	52	0.7059	0.2156	0.7059	0.8402
No log	0.3017	54	0.6991	0.0517	0.6991	0.8361
No log	0.3128	56	0.6654	0.0740	0.6654	0.8157
No log	0.3240	58	0.6231	0.2551	0.6231	0.7893
No log	0.3352	60	0.6004	0.4372	0.6004	0.7749
No log	0.3464	62	0.5640	0.3551	0.5640	0.7510
No log	0.3575	64	0.5917	0.2597	0.5917	0.7692
No log	0.3687	66	0.5398	0.3655	0.5398	0.7347
No log	0.3799	68	0.5548	0.3245	0.5548	0.7449
No log	0.3911	70	0.5433	0.3761	0.5433	0.7371
No log	0.4022	72	0.6276	0.5009	0.6276	0.7922
No log	0.4134	74	0.6422	0.4857	0.6422	0.8014
No log	0.4246	76	0.6329	0.4868	0.6329	0.7955
No log	0.4358	78	0.6495	0.4852	0.6495	0.8059
No log	0.4469	80	0.6585	0.4822	0.6585	0.8115
No log	0.4581	82	0.6359	0.4755	0.6359	0.7975
No log	0.4693	84	0.5829	0.2777	0.5829	0.7635
No log	0.4804	86	0.5607	0.3487	0.5607	0.7488
No log	0.4916	88	0.5645	0.4783	0.5645	0.7513
No log	0.5028	90	0.5591	0.4009	0.5591	0.7477
No log	0.5140	92	0.5783	0.2442	0.5783	0.7605
No log	0.5251	94	0.5575	0.2806	0.5575	0.7467
No log	0.5363	96	0.5437	0.4611	0.5437	0.7374
No log	0.5475	98	0.5445	0.4373	0.5445	0.7379
No log	0.5587	100	0.5751	0.4036	0.5751	0.7584
No log	0.5698	102	0.5608	0.3956	0.5608	0.7489
No log	0.5810	104	0.4952	0.4973	0.4952	0.7037
No log	0.5922	106	0.5667	0.5843	0.5667	0.7528
No log	0.6034	108	0.7869	0.4884	0.7869	0.8871
No log	0.6145	110	0.6674	0.5044	0.6674	0.8169
No log	0.6257	112	0.5644	0.3499	0.5644	0.7513
No log	0.6369	114	0.5541	0.3322	0.5541	0.7444
No log	0.6480	116	0.5482	0.5519	0.5482	0.7404
No log	0.6592	118	0.5291	0.5418	0.5291	0.7274
No log	0.6704	120	0.4994	0.4532	0.4994	0.7067
No log	0.6816	122	0.5080	0.5357	0.5080	0.7128
No log	0.6927	124	0.4973	0.4985	0.4973	0.7052
No log	0.7039	126	0.5105	0.5084	0.5105	0.7145
No log	0.7151	128	0.5606	0.5444	0.5606	0.7487
No log	0.7263	130	0.6733	0.5003	0.6733	0.8206
No log	0.7374	132	0.5795	0.5541	0.5795	0.7613
No log	0.7486	134	0.5313	0.4315	0.5313	0.7289
No log	0.7598	136	0.5484	0.4033	0.5484	0.7406
No log	0.7709	138	0.5176	0.5033	0.5176	0.7194
No log	0.7821	140	0.6538	0.4642	0.6538	0.8086
No log	0.7933	142	0.6201	0.5025	0.6201	0.7874
No log	0.8045	144	0.4900	0.5299	0.4900	0.7000
No log	0.8156	146	0.4810	0.4766	0.4810	0.6936
No log	0.8268	148	0.4853	0.5128	0.4853	0.6966
No log	0.8380	150	0.4811	0.5080	0.4811	0.6936
No log	0.8492	152	0.4805	0.5099	0.4805	0.6932
No log	0.8603	154	0.5039	0.5396	0.5039	0.7098
No log	0.8715	156	0.4994	0.5223	0.4994	0.7067
No log	0.8827	158	0.5256	0.4828	0.5256	0.7250
No log	0.8939	160	0.4990	0.4847	0.4990	0.7064
No log	0.9050	162	0.5497	0.5846	0.5497	0.7414
No log	0.9162	164	0.5888	0.5823	0.5888	0.7673
No log	0.9274	166	0.6026	0.5455	0.6026	0.7763
No log	0.9385	168	0.6546	0.5613	0.6546	0.8091
No log	0.9497	170	0.7577	0.5529	0.7577	0.8704
No log	0.9609	172	0.5702	0.5686	0.5702	0.7551
No log	0.9721	174	0.4847	0.4493	0.4847	0.6962
No log	0.9832	176	0.5760	0.3724	0.5760	0.7590
No log	0.9944	178	0.5335	0.3929	0.5335	0.7304
No log	1.0056	180	0.4760	0.4867	0.4760	0.6899
No log	1.0168	182	0.5010	0.5096	0.5010	0.7078
No log	1.0279	184	0.4746	0.4797	0.4746	0.6889
No log	1.0391	186	0.4866	0.4674	0.4866	0.6975
No log	1.0503	188	0.4695	0.4884	0.4695	0.6852
No log	1.0615	190	0.4655	0.4872	0.4655	0.6823
No log	1.0726	192	0.4658	0.4860	0.4658	0.6825
No log	1.0838	194	0.4647	0.5409	0.4647	0.6817
No log	1.0950	196	0.5417	0.6083	0.5417	0.7360
No log	1.1061	198	0.6475	0.5942	0.6475	0.8047
No log	1.1173	200	0.5684	0.6050	0.5684	0.7539
No log	1.1285	202	0.6598	0.6002	0.6598	0.8123
No log	1.1397	204	0.7865	0.5633	0.7865	0.8869
No log	1.1508	206	0.7174	0.5718	0.7174	0.8470
No log	1.1620	208	0.5435	0.5227	0.5435	0.7372
No log	1.1732	210	0.5147	0.4657	0.5147	0.7174
No log	1.1844	212	0.4874	0.5021	0.4874	0.6981
No log	1.1955	214	0.5196	0.5598	0.5196	0.7208
No log	1.2067	216	0.6582	0.6144	0.6582	0.8113
No log	1.2179	218	0.5834	0.5929	0.5834	0.7638
No log	1.2291	220	0.5108	0.5496	0.5108	0.7147
No log	1.2402	222	0.4806	0.5055	0.4806	0.6933
No log	1.2514	224	0.4735	0.5048	0.4735	0.6881
No log	1.2626	226	0.5333	0.5824	0.5333	0.7302
No log	1.2737	228	0.7120	0.5725	0.7120	0.8438
No log	1.2849	230	0.6984	0.5797	0.6984	0.8357
No log	1.2961	232	0.5236	0.6022	0.5236	0.7236
No log	1.3073	234	0.4875	0.5820	0.4875	0.6982
No log	1.3184	236	0.5136	0.6053	0.5136	0.7166
No log	1.3296	238	0.5221	0.6084	0.5221	0.7226
No log	1.3408	240	0.5733	0.5974	0.5733	0.7571
No log	1.3520	242	0.4677	0.5632	0.4677	0.6839
No log	1.3631	244	0.4593	0.4817	0.4593	0.6777
No log	1.3743	246	0.4456	0.5128	0.4456	0.6675
No log	1.3855	248	0.5126	0.5956	0.5126	0.7160
No log	1.3966	250	0.5307	0.5946	0.5307	0.7285
No log	1.4078	252	0.4653	0.5764	0.4653	0.6821
No log	1.4190	254	0.4543	0.4906	0.4543	0.6740
No log	1.4302	256	0.4529	0.5454	0.4529	0.6730
No log	1.4413	258	0.6012	0.5739	0.6012	0.7754
No log	1.4525	260	0.9200	0.5235	0.9200	0.9592
No log	1.4637	262	0.8919	0.5466	0.8919	0.9444
No log	1.4749	264	0.5692	0.5971	0.5692	0.7544
No log	1.4860	266	0.4854	0.6179	0.4854	0.6967
No log	1.4972	268	0.5540	0.6013	0.5540	0.7443
No log	1.5084	270	0.7070	0.5818	0.7070	0.8408
No log	1.5196	272	0.6203	0.5951	0.6203	0.7876
No log	1.5307	274	0.4611	0.6108	0.4611	0.6790
No log	1.5419	276	0.4613	0.5172	0.4613	0.6792
No log	1.5531	278	0.4678	0.5201	0.4678	0.6840
No log	1.5642	280	0.4555	0.5975	0.4555	0.6749
No log	1.5754	282	0.6101	0.6224	0.6101	0.7811
No log	1.5866	284	0.5622	0.6099	0.5622	0.7498
No log	1.5978	286	0.4671	0.5997	0.4671	0.6834
No log	1.6089	288	0.4888	0.6074	0.4888	0.6992
No log	1.6201	290	0.4883	0.6233	0.4883	0.6988
No log	1.6313	292	0.4541	0.6220	0.4541	0.6739
No log	1.6425	294	0.4579	0.6162	0.4579	0.6767
No log	1.6536	296	0.4504	0.5665	0.4504	0.6711
No log	1.6648	298	0.4931	0.5390	0.4931	0.7022
No log	1.6760	300	0.5318	0.5066	0.5318	0.7292
No log	1.6872	302	0.4741	0.5542	0.4741	0.6886
No log	1.6983	304	0.4538	0.5473	0.4538	0.6736
No log	1.7095	306	0.4328	0.5522	0.4328	0.6579
No log	1.7207	308	0.4318	0.5614	0.4318	0.6571
No log	1.7318	310	0.4961	0.6089	0.4961	0.7044
No log	1.7430	312	0.7331	0.5587	0.7331	0.8562
No log	1.7542	314	0.8995	0.5096	0.8995	0.9484
No log	1.7654	316	0.8307	0.5412	0.8307	0.9114
No log	1.7765	318	0.5984	0.5870	0.5984	0.7736
No log	1.7877	320	0.4717	0.5695	0.4717	0.6868
No log	1.7989	322	0.4444	0.5536	0.4444	0.6666
No log	1.8101	324	0.4608	0.6018	0.4608	0.6788
No log	1.8212	326	0.4814	0.6051	0.4814	0.6938
No log	1.8324	328	0.4359	0.5770	0.4359	0.6602
No log	1.8436	330	0.4337	0.5648	0.4337	0.6586
No log	1.8547	332	0.4429	0.5884	0.4429	0.6655
No log	1.8659	334	0.4310	0.5524	0.4310	0.6565
No log	1.8771	336	0.4328	0.5548	0.4328	0.6579
No log	1.8883	338	0.4613	0.5983	0.4613	0.6792
No log	1.8994	340	0.4358	0.5473	0.4358	0.6601
No log	1.9106	342	0.4534	0.5846	0.4534	0.6734
No log	1.9218	344	0.5104	0.6399	0.5104	0.7144
No log	1.9330	346	0.5052	0.6505	0.5052	0.7108
No log	1.9441	348	0.4934	0.6491	0.4934	0.7024
No log	1.9553	350	0.4507	0.5527	0.4507	0.6714
No log	1.9665	352	0.4909	0.6343	0.4909	0.7006
No log	1.9777	354	0.5585	0.6742	0.5585	0.7473
No log	1.9888	356	0.5229	0.6432	0.5229	0.7231
No log	2.0	358	0.4673	0.5753	0.4673	0.6836
No log	2.0112	360	0.5297	0.6246	0.5297	0.7278
No log	2.0223	362	0.5639	0.6254	0.5639	0.7509
No log	2.0335	364	0.4984	0.5660	0.4984	0.7059
No log	2.0447	366	0.4902	0.5563	0.4902	0.7001
No log	2.0559	368	0.4957	0.5731	0.4957	0.7041
No log	2.0670	370	0.4752	0.5640	0.4752	0.6893
No log	2.0782	372	0.4615	0.5434	0.4615	0.6794
No log	2.0894	374	0.4963	0.5755	0.4963	0.7045
No log	2.1006	376	0.4832	0.5758	0.4832	0.6951
No log	2.1117	378	0.5863	0.5924	0.5863	0.7657
No log	2.1229	380	0.5976	0.5914	0.5976	0.7730
No log	2.1341	382	0.5673	0.5919	0.5673	0.7532
No log	2.1453	384	0.6518	0.6217	0.6518	0.8073
No log	2.1564	386	0.7819	0.6519	0.7819	0.8843
No log	2.1676	388	0.6156	0.6255	0.6156	0.7846
No log	2.1788	390	0.5213	0.5712	0.5213	0.7220
No log	2.1899	392	0.5410	0.5598	0.5410	0.7355
No log	2.2011	394	0.7194	0.6276	0.7194	0.8481
No log	2.2123	396	0.7334	0.6143	0.7334	0.8564
No log	2.2235	398	0.5510	0.6186	0.5510	0.7423
No log	2.2346	400	0.4417	0.5415	0.4417	0.6646
No log	2.2458	402	0.4361	0.5321	0.4361	0.6603
No log	2.2570	404	0.4917	0.6233	0.4917	0.7012
No log	2.2682	406	0.6698	0.6697	0.6698	0.8184
No log	2.2793	408	0.6036	0.6703	0.6036	0.7769
No log	2.2905	410	0.4426	0.5601	0.4426	0.6653
No log	2.3017	412	0.5022	0.4538	0.5022	0.7086
No log	2.3128	414	0.4995	0.4519	0.4995	0.7068
No log	2.3240	416	0.4388	0.5495	0.4388	0.6624
No log	2.3352	418	0.5714	0.6609	0.5714	0.7559
No log	2.3464	420	0.6112	0.6853	0.6112	0.7818
No log	2.3575	422	0.4769	0.5935	0.4769	0.6906
No log	2.3687	424	0.4495	0.5733	0.4495	0.6705
No log	2.3799	426	0.5214	0.6427	0.5214	0.7221
No log	2.3911	428	0.5819	0.6559	0.5819	0.7628
No log	2.4022	430	0.5562	0.6660	0.5562	0.7458
No log	2.4134	432	0.6368	0.7093	0.6368	0.7980
No log	2.4246	434	0.5731	0.6867	0.5731	0.7570
No log	2.4358	436	0.4560	0.5743	0.4560	0.6753
No log	2.4469	438	0.4769	0.4876	0.4769	0.6906
No log	2.4581	440	0.4495	0.5483	0.4495	0.6704
No log	2.4693	442	0.4745	0.6311	0.4745	0.6888
No log	2.4804	444	0.5954	0.6888	0.5954	0.7716
No log	2.4916	446	0.5405	0.6536	0.5405	0.7352
No log	2.5028	448	0.4435	0.5639	0.4435	0.6659
No log	2.5140	450	0.4432	0.5440	0.4432	0.6658
No log	2.5251	452	0.4823	0.6339	0.4823	0.6945
No log	2.5363	454	0.5768	0.6709	0.5768	0.7594
No log	2.5475	456	0.5438	0.6791	0.5438	0.7374
No log	2.5587	458	0.5045	0.6720	0.5045	0.7103
No log	2.5698	460	0.5491	0.6822	0.5491	0.7410
No log	2.5810	462	0.6240	0.6885	0.6240	0.7899
No log	2.5922	464	0.5970	0.7045	0.5970	0.7727
No log	2.6034	466	0.5184	0.6752	0.5184	0.7200
No log	2.6145	468	0.4585	0.6249	0.4585	0.6771
No log	2.6257	470	0.4239	0.5476	0.4239	0.6511
No log	2.6369	472	0.4188	0.5426	0.4188	0.6471
No log	2.6480	474	0.4256	0.5722	0.4256	0.6524
No log	2.6592	476	0.4782	0.6044	0.4782	0.6915
No log	2.6704	478	0.5225	0.6166	0.5225	0.7229
No log	2.6816	480	0.4466	0.5741	0.4466	0.6683
No log	2.6927	482	0.4350	0.5398	0.4350	0.6595
No log	2.7039	484	0.4596	0.5476	0.4596	0.6779
No log	2.7151	486	0.6130	0.6431	0.6130	0.7829
No log	2.7263	488	0.7302	0.6491	0.7302	0.8545
No log	2.7374	490	0.6629	0.6723	0.6629	0.8142
No log	2.7486	492	0.4984	0.5703	0.4984	0.7059
No log	2.7598	494	0.4743	0.5711	0.4743	0.6887
No log	2.7709	496	0.5263	0.6440	0.5263	0.7255
No log	2.7821	498	0.5766	0.6844	0.5766	0.7593
0.5009	2.7933	500	0.5338	0.6794	0.5338	0.7306
0.5009	2.8045	502	0.4528	0.5715	0.4528	0.6729
0.5009	2.8156	504	0.4470	0.5084	0.4470	0.6686
0.5009	2.8268	506	0.4627	0.5864	0.4627	0.6802
0.5009	2.8380	508	0.4715	0.6247	0.4715	0.6867
0.5009	2.8492	510	0.5202	0.6755	0.5202	0.7213

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1