DREsS_FineTuningBERT_AugAlpha100_organization_fold0

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5707
• Qwk: 0.3361
• Mse: 0.6970
• Rmse: 0.8348

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0043	2	5.7000	0.0	6.8535	2.6179
No log	0.0085	4	4.1822	-0.0026	3.0808	1.7552
No log	0.0128	6	2.9545	-0.0018	2.9596	1.7203
No log	0.0171	8	2.1538	0.0	2.9343	1.7130
No log	0.0213	10	1.5272	0.0861	1.0606	1.0299
No log	0.0256	12	1.1547	0.0	1.0152	1.0075
No log	0.0299	14	0.9006	0.0	1.0152	1.0075
No log	0.0341	16	0.7781	0.0	1.0152	1.0075
No log	0.0384	18	0.7931	0.0016	1.0152	1.0075
No log	0.0426	20	0.8104	-0.1584	1.2374	1.1124
No log	0.0469	22	0.8505	-0.2397	1.3081	1.1437
No log	0.0512	24	0.8558	-0.2166	1.2778	1.1304
No log	0.0554	26	0.8130	0.0227	1.0707	1.0347
No log	0.0597	28	0.8048	-0.1274	1.1919	1.0918
No log	0.0640	30	0.9271	-0.0145	1.0303	1.0150
No log	0.0682	32	0.8517	-0.0699	1.0909	1.0445
No log	0.0725	34	0.7941	-0.0494	1.1364	1.0660
No log	0.0768	36	0.7917	-0.0268	1.1162	1.0565
No log	0.0810	38	0.9017	-0.0038	1.0202	1.0101
No log	0.0853	40	0.9074	-0.0091	1.0253	1.0125
No log	0.0896	42	0.7613	0.0819	0.9747	0.9873
No log	0.0938	44	0.7986	0.0054	1.0101	1.0050
No log	0.0981	46	0.9191	0.0	1.0152	1.0075
No log	0.1023	48	1.0286	0.0	1.0152	1.0075
No log	0.1066	50	0.8099	0.0	1.0152	1.0075
No log	0.1109	52	0.8387	0.0	1.0152	1.0075
No log	0.1151	54	1.0808	0.0	1.0152	1.0075
No log	0.1194	56	1.0683	0.0	1.0152	1.0075
No log	0.1237	58	0.8508	0.0	1.0152	1.0075
No log	0.1279	60	0.7814	-0.0191	1.0354	1.0175
No log	0.1322	62	0.8175	0.0	1.0152	1.0075
No log	0.1365	64	0.7848	-0.0439	1.0657	1.0323
No log	0.1407	66	0.7807	-0.0122	1.1061	1.0517
No log	0.1450	68	0.7723	-0.0071	1.0758	1.0372
No log	0.1493	70	0.7846	0.0008	1.0152	1.0075
No log	0.1535	72	0.7750	0.0054	1.0101	1.0050
No log	0.1578	74	0.7709	0.0461	1.0404	1.0200
No log	0.1620	76	0.7860	0.0447	1.0455	1.0225
No log	0.1663	78	0.7649	0.0297	1.0606	1.0299
No log	0.1706	80	0.7723	0.0	1.0152	1.0075
No log	0.1748	82	0.7889	0.0	1.0152	1.0075
No log	0.1791	84	0.7927	0.0	1.0152	1.0075
No log	0.1834	86	0.8118	0.0	1.0152	1.0075
No log	0.1876	88	0.7734	0.0	1.0152	1.0075
No log	0.1919	90	0.7699	0.0	1.0152	1.0075
No log	0.1962	92	0.7649	0.0	1.0152	1.0075
No log	0.2004	94	0.7576	0.0	1.0152	1.0075
No log	0.2047	96	0.7529	0.0756	0.9444	0.9718
No log	0.2090	98	0.7567	0.0054	1.0101	1.0050
No log	0.2132	100	0.7626	0.0	1.0152	1.0075
No log	0.2175	102	0.7579	0.0314	0.9848	0.9924
No log	0.2217	104	0.7605	0.0101	1.0101	1.0050
No log	0.2260	106	0.7508	0.0346	0.9899	0.9949
No log	0.2303	108	0.7850	0.0	1.0152	1.0075
No log	0.2345	110	0.7950	0.0	1.0152	1.0075
No log	0.2388	112	0.7485	0.0375	0.9798	0.9898
No log	0.2431	114	0.7361	0.2044	0.8586	0.9266
No log	0.2473	116	0.7353	0.1938	0.8737	0.9347
No log	0.2516	118	0.7274	0.0927	0.9343	0.9666
No log	0.2559	120	0.8354	0.0	1.0152	1.0075
No log	0.2601	122	0.8895	0.0	1.0152	1.0075
No log	0.2644	124	0.7787	0.0054	1.0101	1.0050
No log	0.2687	126	0.7118	0.2056	0.8434	0.9184
No log	0.2729	128	0.7557	0.0838	1.0	1.0
No log	0.2772	130	0.7637	0.0802	1.0051	1.0025
No log	0.2814	132	0.7281	0.1950	0.8737	0.9347
No log	0.2857	134	0.7030	0.2297	0.8081	0.8989
No log	0.2900	136	0.7169	0.0581	0.9596	0.9796
No log	0.2942	138	0.7142	0.0345	0.9848	0.9924
No log	0.2985	140	0.7002	0.2162	0.8232	0.9073
No log	0.3028	142	0.7017	0.2461	0.8081	0.8989
No log	0.3070	144	0.7031	0.2417	0.8131	0.9017
No log	0.3113	146	0.7016	0.2016	0.8535	0.9239
No log	0.3156	148	0.6891	0.2366	0.8030	0.8961
No log	0.3198	150	0.7195	0.0732	0.9495	0.9744
No log	0.3241	152	0.7149	0.1123	0.9141	0.9561
No log	0.3284	154	0.6646	0.2671	0.7778	0.8819
No log	0.3326	156	0.7400	0.1633	0.9091	0.9535
No log	0.3369	158	0.8116	0.0931	0.9899	0.9949
No log	0.3412	160	0.8016	0.0924	0.9899	0.9949
No log	0.3454	162	0.7394	0.1695	0.8990	0.9482
No log	0.3497	164	0.7055	0.1650	0.8889	0.9428
No log	0.3539	166	0.7211	0.0763	0.9697	0.9847
No log	0.3582	168	0.7022	0.1884	0.8636	0.9293
No log	0.3625	170	0.7192	0.1439	0.9242	0.9614
No log	0.3667	172	0.7397	0.1584	0.9141	0.9561
No log	0.3710	174	0.7192	0.1882	0.8788	0.9374
No log	0.3753	176	0.6899	0.2090	0.8485	0.9211
No log	0.3795	178	0.6907	0.2108	0.8485	0.9211
No log	0.3838	180	0.6941	0.2007	0.8636	0.9293
No log	0.3881	182	0.6903	0.1963	0.8687	0.9320
No log	0.3923	184	0.6688	0.2534	0.8030	0.8961
No log	0.3966	186	0.6509	0.2650	0.7879	0.8876
No log	0.4009	188	0.6499	0.2490	0.8081	0.8989
No log	0.4051	190	0.6883	0.1851	0.8838	0.9401
No log	0.4094	192	0.6671	0.2430	0.8182	0.9045
No log	0.4136	194	0.6483	0.2644	0.7929	0.8905
No log	0.4179	196	0.6288	0.2594	0.7929	0.8905
No log	0.4222	198	0.6284	0.2308	0.8182	0.9045
No log	0.4264	200	0.6290	0.2650	0.7879	0.8876
No log	0.4307	202	0.7380	0.2049	0.8636	0.9293
No log	0.4350	204	0.8022	0.1251	0.9545	0.9770
No log	0.4392	206	0.7423	0.1460	0.9293	0.9640
No log	0.4435	208	0.6336	0.2849	0.7677	0.8762
No log	0.4478	210	0.6318	0.2339	0.8081	0.8989
No log	0.4520	212	0.6243	0.2513	0.7879	0.8876
No log	0.4563	214	0.6157	0.3082	0.7424	0.8616
No log	0.4606	216	0.6316	0.3009	0.7525	0.8675
No log	0.4648	218	0.5989	0.3155	0.7323	0.8558
No log	0.4691	220	0.5956	0.3533	0.6869	0.8288
No log	0.4733	222	0.6128	0.2722	0.7677	0.8762
No log	0.4776	224	0.6042	0.3273	0.7172	0.8469
No log	0.4819	226	0.6775	0.2112	0.8535	0.9239
No log	0.4861	228	0.7397	0.1510	0.9242	0.9614
No log	0.4904	230	0.7033	0.1851	0.8838	0.9401
No log	0.4947	232	0.6172	0.3121	0.7374	0.8587
No log	0.4989	234	0.6223	0.2637	0.7727	0.8790
No log	0.5032	236	0.6370	0.2421	0.7929	0.8905
No log	0.5075	238	0.5881	0.3663	0.6717	0.8196
No log	0.5117	240	0.6386	0.2512	0.8081	0.8989
No log	0.5160	242	0.6970	0.2005	0.8687	0.9320
No log	0.5203	244	0.6577	0.2535	0.8081	0.8989
No log	0.5245	246	0.5832	0.3503	0.6919	0.8318
No log	0.5288	248	0.5828	0.3558	0.6818	0.8257
No log	0.5330	250	0.5814	0.3398	0.7020	0.8379
No log	0.5373	252	0.6217	0.3142	0.7374	0.8587
No log	0.5416	254	0.6343	0.2727	0.7828	0.8848
No log	0.5458	256	0.6539	0.2501	0.8081	0.8989
No log	0.5501	258	0.6288	0.2617	0.7929	0.8905
No log	0.5544	260	0.5892	0.3303	0.7121	0.8439
No log	0.5586	262	0.5921	0.3301	0.7071	0.8409
No log	0.5629	264	0.5962	0.2934	0.7525	0.8675
No log	0.5672	266	0.6154	0.3060	0.7424	0.8616
No log	0.5714	268	0.6177	0.3060	0.7424	0.8616
No log	0.5757	270	0.6075	0.3050	0.7424	0.8616
No log	0.5800	272	0.6197	0.3165	0.7323	0.8558
No log	0.5842	274	0.6228	0.3121	0.7374	0.8587
No log	0.5885	276	0.6365	0.3032	0.7475	0.8646
No log	0.5928	278	0.6173	0.3249	0.7222	0.8498
No log	0.5970	280	0.5997	0.3139	0.7323	0.8558
No log	0.6013	282	0.6066	0.3344	0.7121	0.8439
No log	0.6055	284	0.6492	0.2920	0.7626	0.8733
No log	0.6098	286	0.6457	0.3025	0.7525	0.8675
No log	0.6141	288	0.5699	0.3308	0.7121	0.8439
No log	0.6183	290	0.6030	0.2670	0.7626	0.8733
No log	0.6226	292	0.6056	0.2978	0.7374	0.8587
No log	0.6269	294	0.5470	0.3096	0.7374	0.8587
No log	0.6311	296	0.6535	0.3079	0.7475	0.8646
No log	0.6354	298	0.7470	0.2409	0.8232	0.9073
No log	0.6397	300	0.6808	0.2854	0.7727	0.8790
No log	0.6439	302	0.5587	0.3354	0.7121	0.8439
No log	0.6482	304	0.5482	0.3768	0.6667	0.8165
No log	0.6525	306	0.5497	0.3714	0.6717	0.8196
No log	0.6567	308	0.5492	0.3227	0.7273	0.8528
No log	0.6610	310	0.5789	0.3230	0.7273	0.8528
No log	0.6652	312	0.5896	0.3280	0.7222	0.8498
No log	0.6695	314	0.5866	0.3475	0.7071	0.8409
No log	0.6738	316	0.5968	0.3236	0.7273	0.8528
No log	0.6780	318	0.6485	0.3074	0.7475	0.8646
No log	0.6823	320	0.6638	0.2837	0.7727	0.8790
No log	0.6866	322	0.6814	0.2606	0.7980	0.8933
No log	0.6908	324	0.6823	0.2486	0.8131	0.9017
No log	0.6951	326	0.6299	0.2584	0.7980	0.8933
No log	0.6994	328	0.6225	0.3003	0.7525	0.8675
No log	0.7036	330	0.6152	0.3225	0.7273	0.8528
No log	0.7079	332	0.6722	0.2700	0.7879	0.8876
No log	0.7122	334	0.6614	0.2975	0.7576	0.8704
No log	0.7164	336	0.5997	0.3463	0.7020	0.8379
No log	0.7207	338	0.5871	0.3225	0.7273	0.8528
No log	0.7249	340	0.5709	0.3110	0.7374	0.8587
No log	0.7292	342	0.5802	0.2943	0.7576	0.8704
No log	0.7335	344	0.6217	0.2854	0.7727	0.8790
No log	0.7377	346	0.6417	0.2859	0.7727	0.8790
No log	0.7420	348	0.5946	0.3027	0.7475	0.8646
No log	0.7463	350	0.5814	0.3770	0.6768	0.8227
No log	0.7505	352	0.5972	0.3445	0.7071	0.8409
No log	0.7548	354	0.6175	0.3027	0.7475	0.8646
No log	0.7591	356	0.7025	0.2667	0.7929	0.8905
No log	0.7633	358	0.6653	0.2799	0.7778	0.8819
No log	0.7676	360	0.6067	0.3150	0.7323	0.8558
No log	0.7719	362	0.6072	0.3205	0.7273	0.8528
No log	0.7761	364	0.6310	0.3048	0.7475	0.8646
No log	0.7804	366	0.6207	0.3042	0.7475	0.8646
No log	0.7846	368	0.6503	0.2970	0.7576	0.8704
No log	0.7889	370	0.6374	0.3551	0.7121	0.8439
No log	0.7932	372	0.6129	0.3790	0.6970	0.8348
No log	0.7974	374	0.6435	0.3407	0.7172	0.8469
No log	0.8017	376	0.7495	0.2409	0.8232	0.9073
No log	0.8060	378	0.6766	0.2392	0.8232	0.9073
No log	0.8102	380	0.5536	0.3824	0.6667	0.8165
No log	0.8145	382	0.5624	0.3800	0.6919	0.8318
No log	0.8188	384	0.5473	0.3797	0.6768	0.8227
No log	0.8230	386	0.5457	0.4114	0.6364	0.7977
No log	0.8273	388	0.6950	0.2442	0.8182	0.9045
No log	0.8316	390	0.7003	0.2442	0.8182	0.9045
No log	0.8358	392	0.5770	0.3981	0.6515	0.8072
No log	0.8401	394	0.5483	0.4156	0.6667	0.8165
No log	0.8443	396	0.5561	0.3652	0.7172	0.8469
No log	0.8486	398	0.5610	0.3912	0.6616	0.8134
No log	0.8529	400	0.6329	0.3345	0.7172	0.8469
No log	0.8571	402	0.6331	0.3433	0.7071	0.8409
No log	0.8614	404	0.5664	0.3617	0.6818	0.8257
No log	0.8657	406	0.5565	0.3778	0.6616	0.8134
No log	0.8699	408	0.5714	0.3433	0.7020	0.8379
No log	0.8742	410	0.5681	0.3567	0.6869	0.8288
No log	0.8785	412	0.5485	0.3718	0.6667	0.8165
No log	0.8827	414	0.5473	0.3790	0.6566	0.8103
No log	0.8870	416	0.5435	0.3749	0.6616	0.8134
No log	0.8913	418	0.5896	0.3552	0.6919	0.8318
No log	0.8955	420	0.6446	0.3345	0.7172	0.8469
No log	0.8998	422	0.5721	0.3592	0.6869	0.8288
No log	0.9041	424	0.5274	0.4405	0.6313	0.7946
No log	0.9083	426	0.5242	0.4359	0.6212	0.7882
No log	0.9126	428	0.5662	0.3603	0.6919	0.8318
No log	0.9168	430	0.5483	0.4429	0.6111	0.7817
No log	0.9211	432	0.5717	0.3499	0.7020	0.8379
No log	0.9254	434	0.5812	0.3829	0.6667	0.8165
No log	0.9296	436	0.5886	0.3647	0.6869	0.8288
No log	0.9339	438	0.5663	0.3869	0.6616	0.8134
No log	0.9382	440	0.5745	0.3780	0.6717	0.8196
No log	0.9424	442	0.5759	0.3682	0.6818	0.8257
No log	0.9467	444	0.5551	0.3564	0.6919	0.8318
No log	0.9510	446	0.5692	0.3717	0.6768	0.8227
No log	0.9552	448	0.5724	0.3667	0.6818	0.8257
No log	0.9595	450	0.5721	0.3806	0.6667	0.8165
No log	0.9638	452	0.5633	0.3849	0.6667	0.8165
No log	0.9680	454	0.5836	0.3647	0.6869	0.8288
No log	0.9723	456	0.6091	0.3107	0.7475	0.8646
No log	0.9765	458	0.5755	0.3886	0.6667	0.8165
No log	0.9808	460	0.5627	0.4152	0.6414	0.8009
No log	0.9851	462	0.5802	0.3618	0.6970	0.8348
No log	0.9893	464	0.5855	0.3190	0.7374	0.8587
No log	0.9936	466	0.5575	0.3534	0.6970	0.8348
No log	0.9979	468	0.5464	0.4069	0.6364	0.7977
No log	1.0021	470	0.5466	0.3660	0.6818	0.8257
No log	1.0064	472	0.5447	0.3858	0.6566	0.8103
No log	1.0107	474	0.6093	0.3330	0.7172	0.8469
No log	1.0149	476	0.6657	0.3030	0.7525	0.8675
No log	1.0192	478	0.5810	0.3514	0.7020	0.8379
No log	1.0235	480	0.5383	0.4299	0.6465	0.8040
No log	1.0277	482	0.5367	0.4251	0.6414	0.8009
No log	1.0320	484	0.5725	0.3509	0.7020	0.8379
No log	1.0362	486	0.5982	0.3524	0.7020	0.8379
No log	1.0405	488	0.5740	0.3794	0.6717	0.8196
No log	1.0448	490	0.5582	0.3963	0.6515	0.8072
No log	1.0490	492	0.5610	0.3696	0.6818	0.8257
No log	1.0533	494	0.5624	0.3834	0.6667	0.8165
No log	1.0576	496	0.5380	0.4525	0.6010	0.7752
No log	1.0618	498	0.5208	0.4782	0.6010	0.7752
0.363	1.0661	500	0.5214	0.4904	0.5859	0.7654
0.363	1.0704	502	0.5510	0.4154	0.6313	0.7946
0.363	1.0746	504	0.5511	0.4005	0.6414	0.8009
0.363	1.0789	506	0.5320	0.4091	0.6414	0.8009
0.363	1.0832	508	0.5895	0.3270	0.7222	0.8498
0.363	1.0874	510	0.5707	0.3361	0.6970	0.8348

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1