ASAP_FineTuningBERT_Aug_k5_task1_organization_fold1

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.4002
• Qwk: 0.6661
• Mse: 0.4002
• Rmse: 0.6326

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0185	2	11.5548	0.0	11.5548	3.3992
No log	0.0370	4	9.4106	0.0	9.4106	3.0677
No log	0.0556	6	7.9931	0.0123	7.9931	2.8272
No log	0.0741	8	6.3112	0.0078	6.3112	2.5122
No log	0.0926	10	5.1257	0.0037	5.1257	2.2640
No log	0.1111	12	4.1232	0.0027	4.1232	2.0306
No log	0.1296	14	3.2413	0.0334	3.2413	1.8004
No log	0.1481	16	2.6106	0.0191	2.6106	1.6157
No log	0.1667	18	2.0719	0.0	2.0719	1.4394
No log	0.1852	20	1.6087	0.0	1.6087	1.2684
No log	0.2037	22	1.2664	0.1787	1.2664	1.1253
No log	0.2222	24	1.1021	0.0418	1.1021	1.0498
No log	0.2407	26	0.9440	0.0211	0.9440	0.9716
No log	0.2593	28	0.8536	0.0315	0.8536	0.9239
No log	0.2778	30	0.9119	0.0	0.9119	0.9549
No log	0.2963	32	0.9758	0.0	0.9758	0.9878
No log	0.3148	34	0.9866	-0.0027	0.9866	0.9933
No log	0.3333	36	0.9212	0.0	0.9212	0.9598
No log	0.3519	38	0.8671	0.0418	0.8671	0.9312
No log	0.3704	40	0.7783	0.0645	0.7783	0.8822
No log	0.3889	42	0.7155	0.0768	0.7155	0.8459
No log	0.4074	44	0.7832	0.0583	0.7832	0.8850
No log	0.4259	46	0.9463	0.0418	0.9463	0.9728
No log	0.4444	48	0.8914	0.0583	0.8914	0.9441
No log	0.4630	50	0.8079	0.0707	0.8079	0.8988
No log	0.4815	52	0.6744	0.1369	0.6744	0.8212
No log	0.5	54	0.6323	0.1653	0.6323	0.7952
No log	0.5185	56	0.6527	0.1239	0.6527	0.8079
No log	0.5370	58	0.6918	0.0828	0.6918	0.8318
No log	0.5556	60	0.5727	0.1938	0.5727	0.7568
No log	0.5741	62	0.5663	0.2477	0.5663	0.7525
No log	0.5926	64	0.6094	0.1530	0.6094	0.7807
No log	0.6111	66	0.6101	0.1219	0.6101	0.7811
No log	0.6296	68	0.6207	0.1441	0.6207	0.7878
No log	0.6481	70	0.6755	0.3920	0.6755	0.8219
No log	0.6667	72	0.8742	0.3602	0.8742	0.9350
No log	0.6852	74	0.8939	0.2367	0.8939	0.9455
No log	0.7037	76	0.8216	0.1553	0.8216	0.9064
No log	0.7222	78	0.6299	0.1766	0.6299	0.7937
No log	0.7407	80	0.6819	0.2694	0.6819	0.8258
No log	0.7593	82	0.7528	0.2713	0.7528	0.8676
No log	0.7778	84	0.5736	0.2384	0.5736	0.7574
No log	0.7963	86	0.7110	0.1427	0.7110	0.8432
No log	0.8148	88	0.8390	0.0817	0.8390	0.9160
No log	0.8333	90	0.7219	0.4593	0.7219	0.8496
No log	0.8519	92	0.5799	0.5649	0.5799	0.7615
No log	0.8704	94	0.5289	0.3385	0.5289	0.7272
No log	0.8889	96	0.5604	0.2951	0.5604	0.7486
No log	0.9074	98	0.5545	0.2602	0.5545	0.7446
No log	0.9259	100	0.5151	0.3440	0.5151	0.7177
No log	0.9444	102	0.5738	0.5809	0.5738	0.7575
No log	0.9630	104	0.5875	0.5815	0.5875	0.7665
No log	0.9815	106	0.5978	0.5792	0.5978	0.7732
No log	1.0	108	0.6291	0.4366	0.6291	0.7931
No log	1.0185	110	0.5502	0.2724	0.5502	0.7418
No log	1.0370	112	0.4944	0.3847	0.4944	0.7031
No log	1.0556	114	0.4574	0.5293	0.4574	0.6763
No log	1.0741	116	0.5171	0.6105	0.5171	0.7191
No log	1.0926	118	0.5382	0.6228	0.5382	0.7336
No log	1.1111	120	0.4955	0.6167	0.4955	0.7040
No log	1.1296	122	0.5105	0.4370	0.5105	0.7145
No log	1.1481	124	0.5261	0.2498	0.5261	0.7253
No log	1.1667	126	0.4911	0.3638	0.4911	0.7008
No log	1.1852	128	0.4456	0.5694	0.4456	0.6676
No log	1.2037	130	0.4237	0.5849	0.4237	0.6510
No log	1.2222	132	0.4245	0.5398	0.4245	0.6516
No log	1.2407	134	0.4284	0.5377	0.4284	0.6546
No log	1.2593	136	0.4510	0.5647	0.4510	0.6716
No log	1.2778	138	0.5590	0.5790	0.5590	0.7476
No log	1.2963	140	0.6654	0.5488	0.6654	0.8157
No log	1.3148	142	0.6576	0.5522	0.6576	0.8109
No log	1.3333	144	0.6248	0.5678	0.6248	0.7904
No log	1.3519	146	0.6422	0.5635	0.6422	0.8014
No log	1.3704	148	0.5180	0.5878	0.5180	0.7197
No log	1.3889	150	0.5064	0.5930	0.5064	0.7116
No log	1.4074	152	0.5108	0.5884	0.5108	0.7147
No log	1.4259	154	0.6197	0.2072	0.6197	0.7872
No log	1.4444	156	0.7919	0.2063	0.7919	0.8899
No log	1.4630	158	0.5753	0.3161	0.5753	0.7585
No log	1.4815	160	0.5505	0.5891	0.5505	0.7420
No log	1.5	162	0.4797	0.5959	0.4797	0.6926
No log	1.5185	164	0.4303	0.5242	0.4303	0.6560
No log	1.5370	166	0.4268	0.5539	0.4268	0.6533
No log	1.5556	168	0.4696	0.6061	0.4696	0.6853
No log	1.5741	170	0.5181	0.6011	0.5181	0.7198
No log	1.5926	172	0.5833	0.4337	0.5833	0.7637
No log	1.6111	174	0.5370	0.4721	0.5370	0.7328
No log	1.6296	176	0.4713	0.5386	0.4713	0.6865
No log	1.6481	178	0.4739	0.5469	0.4739	0.6884
No log	1.6667	180	0.4556	0.6015	0.4556	0.6750
No log	1.6852	182	0.6000	0.6067	0.6000	0.7746
No log	1.7037	184	0.6847	0.5675	0.6847	0.8275
No log	1.7222	186	0.5510	0.6372	0.5510	0.7423
No log	1.7407	188	0.3927	0.6112	0.3927	0.6267
No log	1.7593	190	0.4037	0.5680	0.4037	0.6354
No log	1.7778	192	0.3965	0.6171	0.3965	0.6297
No log	1.7963	194	0.5347	0.6354	0.5347	0.7312
No log	1.8148	196	0.7013	0.5612	0.7013	0.8374
No log	1.8333	198	0.6026	0.5970	0.6026	0.7763
No log	1.8519	200	0.4889	0.6180	0.4889	0.6992
No log	1.8704	202	0.4089	0.5886	0.4089	0.6394
No log	1.8889	204	0.4051	0.5666	0.4051	0.6364
No log	1.9074	206	0.4167	0.5668	0.4167	0.6455
No log	1.9259	208	0.4092	0.5988	0.4092	0.6397
No log	1.9444	210	0.5551	0.6180	0.5551	0.7450
No log	1.9630	212	0.7514	0.5631	0.7514	0.8669
No log	1.9815	214	0.7375	0.5549	0.7375	0.8588
No log	2.0	216	0.6101	0.5870	0.6101	0.7811
No log	2.0185	218	0.4600	0.6000	0.4600	0.6782
No log	2.0370	220	0.4591	0.5971	0.4591	0.6776
No log	2.0556	222	0.4180	0.6028	0.4180	0.6465
No log	2.0741	224	0.4011	0.5643	0.4011	0.6334
No log	2.0926	226	0.3916	0.5925	0.3916	0.6258
No log	2.1111	228	0.5222	0.5962	0.5222	0.7226
No log	2.1296	230	0.6154	0.5899	0.6154	0.7845
No log	2.1481	232	0.4767	0.6254	0.4767	0.6905
No log	2.1667	234	0.4310	0.6234	0.4310	0.6565
No log	2.1852	236	0.4274	0.6255	0.4274	0.6538
No log	2.2037	238	0.4473	0.6343	0.4473	0.6688
No log	2.2222	240	0.4008	0.6400	0.4008	0.6331
No log	2.2407	242	0.4727	0.6746	0.4727	0.6875
No log	2.2593	244	0.6113	0.6452	0.6113	0.7818
No log	2.2778	246	0.5983	0.6546	0.5983	0.7735
No log	2.2963	248	0.4597	0.6855	0.4597	0.6780
No log	2.3148	250	0.4258	0.6657	0.4258	0.6525
No log	2.3333	252	0.4320	0.6787	0.4320	0.6572
No log	2.3519	254	0.3976	0.6709	0.3976	0.6306
No log	2.3704	256	0.4466	0.6746	0.4466	0.6683
No log	2.3889	258	0.6425	0.6510	0.6425	0.8016
No log	2.4074	260	0.6014	0.6514	0.6014	0.7755
No log	2.4259	262	0.4151	0.6607	0.4151	0.6443
No log	2.4444	264	0.3979	0.5663	0.3979	0.6308
No log	2.4630	266	0.4228	0.5482	0.4228	0.6502
No log	2.4815	268	0.3642	0.6321	0.3642	0.6035
No log	2.5	270	0.5598	0.6448	0.5598	0.7482
No log	2.5185	272	0.6592	0.6214	0.6592	0.8119
No log	2.5370	274	0.5146	0.6413	0.5146	0.7174
No log	2.5556	276	0.4041	0.6637	0.4041	0.6357
No log	2.5741	278	0.3731	0.6216	0.3731	0.6108
No log	2.5926	280	0.4081	0.6580	0.4081	0.6389
No log	2.6111	282	0.5537	0.6300	0.5537	0.7441
No log	2.6296	284	0.6187	0.6149	0.6187	0.7866
No log	2.6481	286	0.5413	0.6395	0.5413	0.7357
No log	2.6667	288	0.4343	0.6510	0.4343	0.6590
No log	2.6852	290	0.4094	0.6504	0.4094	0.6398
No log	2.7037	292	0.3626	0.6575	0.3626	0.6021
No log	2.7222	294	0.3705	0.6719	0.3705	0.6087
No log	2.7407	296	0.4200	0.6967	0.4200	0.6481
No log	2.7593	298	0.3975	0.6880	0.3975	0.6304
No log	2.7778	300	0.3804	0.6757	0.3804	0.6168
No log	2.7963	302	0.3670	0.6202	0.3670	0.6058
No log	2.8148	304	0.3697	0.6160	0.3697	0.6081
No log	2.8333	306	0.3673	0.6595	0.3673	0.6061
No log	2.8519	308	0.4704	0.6989	0.4704	0.6859
No log	2.8704	310	0.6832	0.7122	0.6832	0.8265
No log	2.8889	312	0.6975	0.7065	0.6975	0.8352
No log	2.9074	314	0.5524	0.6741	0.5524	0.7432
No log	2.9259	316	0.3844	0.6426	0.3844	0.6200
No log	2.9444	318	0.3746	0.5755	0.3746	0.6120
No log	2.9630	320	0.3879	0.5597	0.3879	0.6228
No log	2.9815	322	0.3903	0.6086	0.3903	0.6247
No log	3.0	324	0.4192	0.6237	0.4192	0.6474
No log	3.0185	326	0.4846	0.6579	0.4846	0.6961
No log	3.0370	328	0.5337	0.6899	0.5337	0.7305
No log	3.0556	330	0.4415	0.6859	0.4415	0.6645
No log	3.0741	332	0.3634	0.6754	0.3634	0.6028
No log	3.0926	334	0.3517	0.6397	0.3517	0.5931
No log	3.1111	336	0.3559	0.6683	0.3559	0.5966
No log	3.1296	338	0.4367	0.6963	0.4367	0.6608
No log	3.1481	340	0.4660	0.6825	0.4660	0.6827
No log	3.1667	342	0.5092	0.6875	0.5092	0.7136
No log	3.1852	344	0.6141	0.7099	0.6141	0.7836
No log	3.2037	346	0.5317	0.7059	0.5317	0.7292
No log	3.2222	348	0.4620	0.6984	0.4620	0.6797
No log	3.2407	350	0.4165	0.7033	0.4165	0.6453
No log	3.2593	352	0.3947	0.6908	0.3947	0.6282
No log	3.2778	354	0.4314	0.7001	0.4314	0.6568
No log	3.2963	356	0.6155	0.6898	0.6155	0.7845
No log	3.3148	358	0.7004	0.6510	0.7004	0.8369
No log	3.3333	360	0.6115	0.6228	0.6115	0.7820
No log	3.3519	362	0.4160	0.6546	0.4160	0.6450
No log	3.3704	364	0.3606	0.6353	0.3606	0.6005
No log	3.3889	366	0.3905	0.6664	0.3905	0.6249
No log	3.4074	368	0.4942	0.7064	0.4942	0.7030
No log	3.4259	370	0.4602	0.7111	0.4602	0.6784
No log	3.4444	372	0.3722	0.6591	0.3722	0.6101
No log	3.4630	374	0.3567	0.6322	0.3567	0.5972
No log	3.4815	376	0.4106	0.6596	0.4106	0.6408
No log	3.5	378	0.6062	0.6777	0.6062	0.7786
No log	3.5185	380	0.6553	0.6770	0.6553	0.8095
No log	3.5370	382	0.5522	0.7003	0.5522	0.7431
No log	3.5556	384	0.3825	0.6528	0.3825	0.6185
No log	3.5741	386	0.3551	0.6157	0.3551	0.5959
No log	3.5926	388	0.3542	0.6391	0.3542	0.5952
No log	3.6111	390	0.3968	0.6934	0.3968	0.6300
No log	3.6296	392	0.5289	0.7360	0.5289	0.7272
No log	3.6481	394	0.5641	0.7324	0.5641	0.7510
No log	3.6667	396	0.4664	0.7215	0.4664	0.6829
No log	3.6852	398	0.3686	0.6596	0.3686	0.6071
No log	3.7037	400	0.3644	0.6228	0.3644	0.6037
No log	3.7222	402	0.3698	0.6522	0.3698	0.6081
No log	3.7407	404	0.4448	0.7018	0.4448	0.6669
No log	3.7593	406	0.5121	0.7334	0.5121	0.7156
No log	3.7778	408	0.4864	0.7285	0.4864	0.6974
No log	3.7963	410	0.4652	0.7289	0.4652	0.6821
No log	3.8148	412	0.3954	0.6920	0.3954	0.6288
No log	3.8333	414	0.3935	0.6938	0.3935	0.6273
No log	3.8519	416	0.4145	0.7044	0.4145	0.6438
No log	3.8704	418	0.5350	0.7386	0.5350	0.7315
No log	3.8889	420	0.5136	0.7276	0.5136	0.7167
No log	3.9074	422	0.4322	0.7046	0.4322	0.6574
No log	3.9259	424	0.4162	0.7028	0.4162	0.6452
No log	3.9444	426	0.4197	0.7167	0.4197	0.6479
No log	3.9630	428	0.3915	0.7001	0.3915	0.6257
No log	3.9815	430	0.3637	0.6780	0.3637	0.6031
No log	4.0	432	0.4015	0.7095	0.4015	0.6336
No log	4.0185	434	0.5808	0.7438	0.5808	0.7621
No log	4.0370	436	0.6433	0.7503	0.6433	0.8020
No log	4.0556	438	0.5545	0.7484	0.5545	0.7447
No log	4.0741	440	0.4391	0.7332	0.4391	0.6626
No log	4.0926	442	0.4348	0.7313	0.4348	0.6594
No log	4.1111	444	0.4101	0.7183	0.4101	0.6404
No log	4.1296	446	0.4366	0.7364	0.4366	0.6608
No log	4.1481	448	0.5353	0.7598	0.5353	0.7317
No log	4.1667	450	0.4877	0.7555	0.4877	0.6983
No log	4.1852	452	0.3681	0.6738	0.3681	0.6067
No log	4.2037	454	0.3569	0.6670	0.3569	0.5974
No log	4.2222	456	0.4121	0.7129	0.4121	0.6420
No log	4.2407	458	0.4614	0.7389	0.4614	0.6793
No log	4.2593	460	0.4529	0.7089	0.4529	0.6730
No log	4.2778	462	0.3886	0.6670	0.3886	0.6234
No log	4.2963	464	0.3729	0.6524	0.3729	0.6107
No log	4.3148	466	0.3736	0.6628	0.3736	0.6112
No log	4.3333	468	0.3890	0.6804	0.3890	0.6237
No log	4.3519	470	0.3833	0.6772	0.3833	0.6191
No log	4.3704	472	0.4470	0.7389	0.4470	0.6686
No log	4.3889	474	0.5194	0.7509	0.5194	0.7207
No log	4.4074	476	0.4853	0.7507	0.4853	0.6966
No log	4.4259	478	0.4489	0.7366	0.4489	0.6700
No log	4.4444	480	0.4262	0.6940	0.4262	0.6528
No log	4.4630	482	0.4771	0.7466	0.4771	0.6907
No log	4.4815	484	0.4547	0.7251	0.4547	0.6743
No log	4.5	486	0.4419	0.7030	0.4419	0.6647
No log	4.5185	488	0.4526	0.7076	0.4526	0.6728
No log	4.5370	490	0.4032	0.6833	0.4032	0.6350
No log	4.5556	492	0.4108	0.6095	0.4108	0.6410
No log	4.5741	494	0.4086	0.6661	0.4086	0.6392
No log	4.5926	496	0.4797	0.7242	0.4797	0.6926
No log	4.6111	498	0.4919	0.7421	0.4919	0.7014
0.5998	4.6296	500	0.4605	0.7209	0.4605	0.6786
0.5998	4.6481	502	0.5153	0.7410	0.5153	0.7179
0.5998	4.6667	504	0.5995	0.7458	0.5995	0.7743
0.5998	4.6852	506	0.6582	0.7496	0.6582	0.8113
0.5998	4.7037	508	0.5532	0.7325	0.5532	0.7438
0.5998	4.7222	510	0.4958	0.7363	0.4958	0.7042
0.5998	4.7407	512	0.4589	0.7391	0.4589	0.6774
0.5998	4.7593	514	0.6046	0.7413	0.6046	0.7775
0.5998	4.7778	516	0.7834	0.7277	0.7834	0.8851
0.5998	4.7963	518	0.6958	0.7424	0.6958	0.8341
0.5998	4.8148	520	0.4810	0.7326	0.4810	0.6936
0.5998	4.8333	522	0.4369	0.7080	0.4369	0.6610
0.5998	4.8519	524	0.5423	0.7456	0.5423	0.7364
0.5998	4.8704	526	0.5399	0.7431	0.5399	0.7348
0.5998	4.8889	528	0.5076	0.7399	0.5076	0.7125
0.5998	4.9074	530	0.5242	0.7397	0.5242	0.7240
0.5998	4.9259	532	0.4313	0.7197	0.4313	0.6567
0.5998	4.9444	534	0.3887	0.6744	0.3887	0.6235
0.5998	4.9630	536	0.4175	0.7135	0.4175	0.6462
0.5998	4.9815	538	0.5082	0.7300	0.5082	0.7129
0.5998	5.0	540	0.5033	0.7310	0.5033	0.7094
0.5998	5.0185	542	0.4216	0.7137	0.4216	0.6493
0.5998	5.0370	544	0.4158	0.7095	0.4158	0.6448
0.5998	5.0556	546	0.4628	0.7312	0.4628	0.6803
0.5998	5.0741	548	0.4429	0.7441	0.4429	0.6655
0.5998	5.0926	550	0.4106	0.7305	0.4106	0.6407
0.5998	5.1111	552	0.3791	0.6647	0.3791	0.6157
0.5998	5.1296	554	0.4105	0.7199	0.4105	0.6407
0.5998	5.1481	556	0.5127	0.7421	0.5127	0.7160
0.5998	5.1667	558	0.6564	0.7440	0.6564	0.8102
0.5998	5.1852	560	0.6110	0.7554	0.6110	0.7816
0.5998	5.2037	562	0.4627	0.7509	0.4627	0.6802
0.5998	5.2222	564	0.3998	0.7022	0.3998	0.6323
0.5998	5.2407	566	0.4044	0.7073	0.4044	0.6359
0.5998	5.2593	568	0.4678	0.7449	0.4678	0.6839
0.5998	5.2778	570	0.5194	0.7435	0.5194	0.7207
0.5998	5.2963	572	0.5158	0.7404	0.5158	0.7182
0.5998	5.3148	574	0.4862	0.7382	0.4862	0.6973
0.5998	5.3333	576	0.4470	0.7289	0.4470	0.6685
0.5998	5.3519	578	0.5147	0.7465	0.5147	0.7174
0.5998	5.3704	580	0.6577	0.7476	0.6577	0.8110
0.5998	5.3889	582	0.5965	0.7573	0.5965	0.7724
0.5998	5.4074	584	0.4501	0.7450	0.4501	0.6709
0.5998	5.4259	586	0.4140	0.7067	0.4140	0.6434
0.5998	5.4444	588	0.4393	0.7322	0.4393	0.6628
0.5998	5.4630	590	0.5333	0.7488	0.5333	0.7303
0.5998	5.4815	592	0.5277	0.7490	0.5277	0.7265
0.5998	5.5	594	0.4535	0.7452	0.4535	0.6734
0.5998	5.5185	596	0.4544	0.7386	0.4544	0.6741
0.5998	5.5370	598	0.5238	0.7394	0.5238	0.7238
0.5998	5.5556	600	0.5581	0.7468	0.5581	0.7471
0.5998	5.5741	602	0.4455	0.7178	0.4455	0.6675
0.5998	5.5926	604	0.4165	0.7021	0.4165	0.6454
0.5998	5.6111	606	0.4764	0.7263	0.4764	0.6902
0.5998	5.6296	608	0.4833	0.7242	0.4833	0.6952
0.5998	5.6481	610	0.4419	0.7033	0.4419	0.6648
0.5998	5.6667	612	0.4207	0.6884	0.4207	0.6486
0.5998	5.6852	614	0.4323	0.6983	0.4323	0.6575
0.5998	5.7037	616	0.4228	0.6934	0.4228	0.6502
0.5998	5.7222	618	0.4002	0.6661	0.4002	0.6326

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1