ASAP_FineTuningBERT_AugV3_k15_task1_organization_fold2

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8092
• Qwk: 0.0737
• Mse: 0.8092
• Rmse: 0.8996

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0012	2	13.9300	0.0	13.9300	3.7323
No log	0.0023	4	12.6953	0.0	12.6953	3.5630
No log	0.0035	6	10.4167	0.0	10.4167	3.2275
No log	0.0046	8	8.7455	-0.0023	8.7455	2.9573
No log	0.0058	10	7.6783	0.0073	7.6783	2.7710
No log	0.0069	12	6.2848	0.0018	6.2848	2.5069
No log	0.0081	14	5.2613	0.0018	5.2613	2.2937
No log	0.0092	16	4.0689	0.0081	4.0689	2.0172
No log	0.0104	18	3.3902	0.0211	3.3902	1.8413
No log	0.0115	20	2.4078	0.0078	2.4078	1.5517
No log	0.0127	22	2.2104	0.0078	2.2104	1.4867
No log	0.0138	24	2.6107	0.0074	2.6107	1.6158
No log	0.0150	26	4.1446	-0.0590	4.1446	2.0358
No log	0.0161	28	2.5453	-0.0007	2.5453	1.5954
No log	0.0173	30	1.5604	-0.0011	1.5604	1.2491
No log	0.0184	32	1.6166	0.0	1.6166	1.2714
No log	0.0196	34	1.9894	0.0	1.9894	1.4105
No log	0.0207	36	2.5772	0.0	2.5772	1.6054
No log	0.0219	38	2.4443	0.0	2.4443	1.5634
No log	0.0230	40	2.1882	0.0	2.1882	1.4793
No log	0.0242	42	2.1363	0.0	2.1363	1.4616
No log	0.0253	44	2.1451	0.0	2.1451	1.4646
No log	0.0265	46	2.1857	0.0	2.1857	1.4784
No log	0.0276	48	1.9447	0.0	1.9447	1.3945
No log	0.0288	50	1.6306	0.0	1.6306	1.2769
No log	0.0300	52	1.6598	0.0	1.6598	1.2883
No log	0.0311	54	1.9206	0.0	1.9206	1.3859
No log	0.0323	56	2.1121	0.0	2.1121	1.4533
No log	0.0334	58	2.4513	0.0	2.4513	1.5657
No log	0.0346	60	2.8435	0.0	2.8435	1.6863
No log	0.0357	62	2.4547	0.0	2.4547	1.5667
No log	0.0369	64	1.7472	0.0	1.7472	1.3218
No log	0.0380	66	1.5125	-0.0068	1.5125	1.2298
No log	0.0392	68	1.7588	0.0	1.7588	1.3262
No log	0.0403	70	2.1049	0.0	2.1049	1.4508
No log	0.0415	72	2.1834	0.0	2.1834	1.4776
No log	0.0426	74	1.9750	0.0	1.9750	1.4053
No log	0.0438	76	1.8132	0.0	1.8132	1.3466
No log	0.0449	78	1.9063	0.0	1.9063	1.3807
No log	0.0461	80	2.1796	0.0	2.1796	1.4764
No log	0.0472	82	2.5189	0.0	2.5189	1.5871
No log	0.0484	84	2.7139	0.0	2.7139	1.6474
No log	0.0495	86	2.9268	0.0	2.9268	1.7108
No log	0.0507	88	2.7400	0.0	2.7400	1.6553
No log	0.0518	90	2.2877	0.0	2.2877	1.5125
No log	0.0530	92	1.8801	0.0	1.8801	1.3712
No log	0.0541	94	1.8382	0.0	1.8382	1.3558
No log	0.0553	96	2.3249	0.0	2.3249	1.5247
No log	0.0565	98	2.5275	0.0	2.5275	1.5898
No log	0.0576	100	2.2982	0.0	2.2982	1.5160
No log	0.0588	102	1.5944	-0.0094	1.5944	1.2627
No log	0.0599	104	1.4416	0.0045	1.4416	1.2007
No log	0.0611	106	1.7703	-0.0043	1.7703	1.3305
No log	0.0622	108	2.4291	0.0	2.4291	1.5586
No log	0.0634	110	2.6074	0.0	2.6074	1.6148
No log	0.0645	112	2.2296	0.0	2.2296	1.4932
No log	0.0657	114	1.7455	-0.0003	1.7455	1.3212
No log	0.0668	116	1.5893	-0.0032	1.5893	1.2607
No log	0.0680	118	1.4455	0.0110	1.4455	1.2023
No log	0.0691	120	1.5835	-0.0006	1.5835	1.2584
No log	0.0703	122	1.9044	0.0	1.9044	1.3800
No log	0.0714	124	2.3172	0.0	2.3172	1.5222
No log	0.0726	126	2.4196	0.0	2.4196	1.5555
No log	0.0737	128	2.1815	0.0	2.1815	1.4770
No log	0.0749	130	1.8787	0.0	1.8787	1.3707
No log	0.0760	132	1.8031	0.0	1.8031	1.3428
No log	0.0772	134	1.5606	-0.0043	1.5606	1.2492
No log	0.0783	136	1.4228	0.0379	1.4228	1.1928
No log	0.0795	138	1.5173	0.0138	1.5173	1.2318
No log	0.0806	140	1.8408	0.0	1.8408	1.3568
No log	0.0818	142	2.4585	0.0	2.4585	1.5680
No log	0.0829	144	2.8332	0.0	2.8332	1.6832
No log	0.0841	146	2.7278	0.0	2.7278	1.6516
No log	0.0853	148	2.3567	0.0	2.3567	1.5352
No log	0.0864	150	1.9080	0.0	1.9080	1.3813
No log	0.0876	152	1.7480	0.0	1.7480	1.3221
No log	0.0887	154	1.8144	0.0	1.8144	1.3470
No log	0.0899	156	1.9239	0.0	1.9239	1.3870
No log	0.0910	158	2.0301	0.0	2.0301	1.4248
No log	0.0922	160	1.9669	0.0	1.9669	1.4025
No log	0.0933	162	1.9510	0.0	1.9510	1.3968
No log	0.0945	164	2.0438	0.0	2.0438	1.4296
No log	0.0956	166	2.0505	0.0	2.0505	1.4319
No log	0.0968	168	2.0506	0.0	2.0506	1.4320
No log	0.0979	170	1.9817	0.0	1.9817	1.4077
No log	0.0991	172	2.0740	0.0	2.0740	1.4402
No log	0.1002	174	2.0752	0.0	2.0752	1.4406
No log	0.1014	176	1.9318	0.0	1.9318	1.3899
No log	0.1025	178	1.8056	0.0	1.8056	1.3437
No log	0.1037	180	1.7797	0.0	1.7797	1.3341
No log	0.1048	182	1.7398	0.0	1.7398	1.3190
No log	0.1060	184	1.6967	0.0	1.6967	1.3026
No log	0.1071	186	1.7825	0.0	1.7825	1.3351
No log	0.1083	188	1.8129	0.0	1.8129	1.3465
No log	0.1094	190	1.9486	0.0	1.9486	1.3959
No log	0.1106	192	1.8465	0.0	1.8465	1.3589
No log	0.1118	194	1.8199	0.0	1.8199	1.3490
No log	0.1129	196	1.9305	0.0	1.9305	1.3894
No log	0.1141	198	2.0921	0.0	2.0921	1.4464
No log	0.1152	200	2.0405	0.0	2.0405	1.4285
No log	0.1164	202	1.8405	0.0	1.8405	1.3566
No log	0.1175	204	1.6464	-0.0011	1.6464	1.2831
No log	0.1187	206	1.6306	-0.0011	1.6306	1.2770
No log	0.1198	208	1.8443	0.0	1.8443	1.3580
No log	0.1210	210	2.1585	0.0	2.1585	1.4692
No log	0.1221	212	2.3675	0.0	2.3675	1.5387
No log	0.1233	214	2.3378	0.0	2.3378	1.5290
No log	0.1244	216	1.9969	0.0	1.9969	1.4131
No log	0.1256	218	1.6015	0.0095	1.6015	1.2655
No log	0.1267	220	1.5241	0.0302	1.5241	1.2345
No log	0.1279	222	1.5471	0.0338	1.5471	1.2438
No log	0.1290	224	1.6426	0.0109	1.6426	1.2816
No log	0.1302	226	1.9230	0.0	1.9230	1.3867
No log	0.1313	228	2.4468	0.0	2.4468	1.5642
No log	0.1325	230	2.8164	0.0	2.8164	1.6782
No log	0.1336	232	2.8129	0.0	2.8129	1.6772
No log	0.1348	234	2.5292	0.0	2.5292	1.5904
No log	0.1359	236	2.1072	0.0	2.1072	1.4516
No log	0.1371	238	1.6693	0.0221	1.6693	1.2920
No log	0.1382	240	1.4522	0.0617	1.4522	1.2051
No log	0.1394	242	1.2287	0.1361	1.2287	1.1085
No log	0.1406	244	1.1695	0.0925	1.1695	1.0814
No log	0.1417	246	1.3385	0.0556	1.3385	1.1569
No log	0.1429	248	1.9388	0.0103	1.9388	1.3924
No log	0.1440	250	2.2249	0.0	2.2249	1.4916
No log	0.1452	252	2.1382	0.0	2.1382	1.4622
No log	0.1463	254	1.7654	-0.0007	1.7654	1.3287
No log	0.1475	256	1.4173	0.0641	1.4173	1.1905
No log	0.1486	258	1.3178	0.1088	1.3178	1.1479
No log	0.1498	260	1.2092	0.1204	1.2092	1.0996
No log	0.1509	262	1.1984	0.1104	1.1984	1.0947
No log	0.1521	264	1.2954	0.1179	1.2954	1.1382
No log	0.1532	266	1.3571	0.0916	1.3571	1.1650
No log	0.1544	268	1.5268	0.0254	1.5268	1.2357
No log	0.1555	270	1.7427	0.0	1.7427	1.3201
No log	0.1567	272	1.7916	0.0	1.7916	1.3385
No log	0.1578	274	1.6850	0.0040	1.6850	1.2981
No log	0.1590	276	1.4727	0.0282	1.4727	1.2135
No log	0.1601	278	1.2814	0.1222	1.2814	1.1320
No log	0.1613	280	1.2371	0.1102	1.2371	1.1123
No log	0.1624	282	1.2140	0.1120	1.2140	1.1018
No log	0.1636	284	1.2038	0.1086	1.2038	1.0972
No log	0.1647	286	1.2382	0.1162	1.2382	1.1127
No log	0.1659	288	1.2642	0.1143	1.2642	1.1244
No log	0.1671	290	1.2742	0.0962	1.2742	1.1288
No log	0.1682	292	1.4160	0.0669	1.4160	1.1900
No log	0.1694	294	1.4794	0.0324	1.4794	1.2163
No log	0.1705	296	1.3451	0.0923	1.3451	1.1598
No log	0.1717	298	1.2825	0.1059	1.2825	1.1325
No log	0.1728	300	1.3406	0.0465	1.3406	1.1578
No log	0.1740	302	1.3951	-0.0045	1.3951	1.1812
No log	0.1751	304	1.4014	0.0055	1.4014	1.1838
No log	0.1763	306	1.4625	0.0121	1.4625	1.2093
No log	0.1774	308	1.6005	-0.0007	1.6005	1.2651
No log	0.1786	310	1.7068	-0.0011	1.7068	1.3065
No log	0.1797	312	1.7331	-0.0011	1.7331	1.3165
No log	0.1809	314	1.6032	0.0011	1.6032	1.2662
No log	0.1820	316	1.4027	0.0855	1.4027	1.1843
No log	0.1832	318	1.2660	0.0935	1.2660	1.1252
No log	0.1843	320	1.1586	0.1105	1.1586	1.0764
No log	0.1855	322	1.1425	0.1016	1.1425	1.0689
No log	0.1866	324	1.2038	0.0897	1.2038	1.0972
No log	0.1878	326	1.2189	0.0897	1.2189	1.1040
No log	0.1889	328	1.2855	0.0575	1.2855	1.1338
No log	0.1901	330	1.4269	-0.0044	1.4269	1.1945
No log	0.1912	332	1.4938	-0.0213	1.4938	1.2222
No log	0.1924	334	1.4128	-0.0185	1.4128	1.1886
No log	0.1935	336	1.3789	-0.0236	1.3789	1.1743
No log	0.1947	338	1.3650	-0.0479	1.3650	1.1683
No log	0.1959	340	1.3388	-0.0288	1.3388	1.1570
No log	0.1970	342	1.3498	-0.0032	1.3498	1.1618
No log	0.1982	344	1.4505	-0.0193	1.4505	1.2044
No log	0.1993	346	1.4838	-0.0271	1.4838	1.2181
No log	0.2005	348	1.4484	-0.0161	1.4484	1.2035
No log	0.2016	350	1.4173	-0.0139	1.4173	1.1905
No log	0.2028	352	1.4901	-0.0280	1.4901	1.2207
No log	0.2039	354	1.6555	-0.0152	1.6555	1.2866
No log	0.2051	356	1.8217	-0.0036	1.8217	1.3497
No log	0.2062	358	1.7733	-0.0057	1.7733	1.3317
No log	0.2074	360	1.5176	0.0146	1.5176	1.2319
No log	0.2085	362	1.4159	0.0766	1.4159	1.1899
No log	0.2097	364	1.5493	0.0171	1.5493	1.2447
No log	0.2108	366	1.5818	0.0088	1.5818	1.2577
No log	0.2120	368	1.4829	0.0250	1.4829	1.2178
No log	0.2131	370	1.3815	0.0794	1.3815	1.1754
No log	0.2143	372	1.2058	0.0941	1.2058	1.0981
No log	0.2154	374	1.0681	0.0776	1.0681	1.0335
No log	0.2166	376	1.0023	0.0665	1.0023	1.0012
No log	0.2177	378	1.0020	0.0665	1.0020	1.0010
No log	0.2189	380	1.0399	0.0920	1.0399	1.0198
No log	0.2200	382	1.1289	0.1030	1.1289	1.0625
No log	0.2212	384	1.2671	0.0915	1.2671	1.1256
No log	0.2224	386	1.3446	0.0512	1.3446	1.1596
No log	0.2235	388	1.3576	0.0447	1.3576	1.1652
No log	0.2247	390	1.2736	0.0859	1.2736	1.1285
No log	0.2258	392	1.1473	0.0936	1.1473	1.0711
No log	0.2270	394	1.0287	0.0899	1.0287	1.0142
No log	0.2281	396	0.9860	0.0880	0.9860	0.9930
No log	0.2293	398	0.9950	0.0903	0.9950	0.9975
No log	0.2304	400	0.9947	0.0903	0.9947	0.9973
No log	0.2316	402	0.9354	0.0847	0.9354	0.9671
No log	0.2327	404	0.8452	0.0703	0.8452	0.9194
No log	0.2339	406	0.8329	0.0703	0.8329	0.9126
No log	0.2350	408	0.8639	0.0752	0.8639	0.9295
No log	0.2362	410	0.9165	0.0903	0.9165	0.9574
No log	0.2373	412	0.9877	0.0909	0.9877	0.9938
No log	0.2385	414	1.0567	0.0896	1.0567	1.0280
No log	0.2396	416	1.1008	0.0909	1.1008	1.0492
No log	0.2408	418	1.1536	0.0912	1.1536	1.0740
No log	0.2419	420	1.2214	0.0593	1.2214	1.1052
No log	0.2431	422	1.3155	-0.0381	1.3155	1.1470
No log	0.2442	424	1.2065	0.0489	1.2065	1.0984
No log	0.2454	426	1.0632	0.0577	1.0632	1.0311
No log	0.2465	428	0.9950	0.0577	0.9950	0.9975
No log	0.2477	430	0.9632	0.0677	0.9632	0.9814
No log	0.2488	432	0.9576	0.0899	0.9576	0.9786
No log	0.25	434	0.9342	0.0899	0.9342	0.9666
No log	0.2512	436	0.9043	0.0903	0.9043	0.9510
No log	0.2523	438	0.8726	0.0628	0.8726	0.9341
No log	0.2535	440	0.8490	0.0527	0.8490	0.9214
No log	0.2546	442	0.8371	0.0577	0.8371	0.9149
No log	0.2558	444	0.8438	0.0565	0.8438	0.9186
No log	0.2569	446	0.8755	0.0750	0.8755	0.9357
No log	0.2581	448	0.9341	0.0838	0.9341	0.9665
No log	0.2592	450	1.0136	0.0905	1.0136	1.0068
No log	0.2604	452	1.0608	0.0961	1.0608	1.0300
No log	0.2615	454	1.0296	0.0905	1.0296	1.0147
No log	0.2627	456	0.9711	0.0826	0.9711	0.9854
No log	0.2638	458	0.9282	0.0838	0.9282	0.9635
No log	0.2650	460	0.8744	0.0890	0.8744	0.9351
No log	0.2661	462	0.8443	0.0726	0.8443	0.9188
No log	0.2673	464	0.8289	0.0726	0.8289	0.9104
No log	0.2684	466	0.8257	0.0726	0.8257	0.9087
No log	0.2696	468	0.8396	0.0834	0.8396	0.9163
No log	0.2707	470	0.8830	0.0838	0.8830	0.9397
No log	0.2719	472	0.9401	0.0848	0.9401	0.9696
No log	0.2730	474	0.9595	0.0848	0.9595	0.9795
No log	0.2742	476	0.9488	0.0848	0.9488	0.9740
No log	0.2753	478	0.9025	0.0826	0.9025	0.9500
No log	0.2765	480	0.8698	0.0886	0.8698	0.9326
No log	0.2776	482	0.8575	0.0844	0.8575	0.9260
No log	0.2788	484	0.8605	0.0844	0.8605	0.9276
No log	0.2800	486	0.8562	0.0828	0.8562	0.9253
No log	0.2811	488	0.8336	0.0828	0.8336	0.9130
No log	0.2823	490	0.8221	0.0780	0.8221	0.9067
No log	0.2834	492	0.8179	0.0780	0.8179	0.9044
No log	0.2846	494	0.8100	0.0793	0.8100	0.9000
No log	0.2857	496	0.8064	0.0793	0.8064	0.8980
No log	0.2869	498	0.8131	0.0780	0.8131	0.9017
1.5483	0.2880	500	0.8218	0.0768	0.8218	0.9066
1.5483	0.2892	502	0.8206	0.0768	0.8206	0.9058
1.5483	0.2903	504	0.8131	0.0768	0.8131	0.9017
1.5483	0.2915	506	0.7938	0.0780	0.7938	0.8909
1.5483	0.2926	508	0.7823	0.0828	0.7823	0.8845
1.5483	0.2938	510	0.7818	0.0780	0.7818	0.8842
1.5483	0.2949	512	0.7808	0.0768	0.7808	0.8836
1.5483	0.2961	514	0.7774	0.0768	0.7774	0.8817
1.5483	0.2972	516	0.7709	0.0780	0.7709	0.8780
1.5483	0.2984	518	0.7682	0.0828	0.7682	0.8765
1.5483	0.2995	520	0.7665	0.0816	0.7665	0.8755
1.5483	0.3007	522	0.7639	0.0816	0.7639	0.8740
1.5483	0.3018	524	0.7603	0.0816	0.7603	0.8719
1.5483	0.3030	526	0.7564	0.0828	0.7564	0.8697
1.5483	0.3041	528	0.7555	0.0877	0.7555	0.8692
1.5483	0.3053	530	0.7565	0.0828	0.7565	0.8698
1.5483	0.3065	532	0.7570	0.0828	0.7570	0.8701
1.5483	0.3076	534	0.7570	0.0828	0.7570	0.8701
1.5483	0.3088	536	0.7572	0.0828	0.7572	0.8702
1.5483	0.3099	538	0.7580	0.0877	0.7580	0.8706
1.5483	0.3111	540	0.7607	0.0828	0.7607	0.8722
1.5483	0.3122	542	0.7697	0.0768	0.7697	0.8773
1.5483	0.3134	544	0.7766	0.0768	0.7766	0.8812
1.5483	0.3145	546	0.7802	0.0768	0.7802	0.8833
1.5483	0.3157	548	0.7788	0.0768	0.7788	0.8825
1.5483	0.3168	550	0.7739	0.0780	0.7739	0.8797
1.5483	0.3180	552	0.7750	0.0780	0.7750	0.8804
1.5483	0.3191	554	0.7758	0.0780	0.7758	0.8808
1.5483	0.3203	556	0.7792	0.0768	0.7792	0.8827
1.5483	0.3214	558	0.7785	0.0768	0.7785	0.8823
1.5483	0.3226	560	0.7751	0.0890	0.7751	0.8804
1.5483	0.3237	562	0.7816	0.0714	0.7816	0.8841
1.5483	0.3249	564	0.7884	0.0640	0.7884	0.8879
1.5483	0.3260	566	0.7924	0.1215	0.7924	0.8902
1.5483	0.3272	568	0.7832	0.0761	0.7832	0.8850
1.5483	0.3283	570	0.7642	0.0906	0.7642	0.8742
1.5483	0.3295	572	0.7571	0.0828	0.7571	0.8701
1.5483	0.3306	574	0.7598	0.0906	0.7598	0.8716
1.5483	0.3318	576	0.7578	0.0906	0.7578	0.8705
1.5483	0.3329	578	0.7547	0.0906	0.7547	0.8688
1.5483	0.3341	580	0.7528	0.0906	0.7528	0.8676
1.5483	0.3353	582	0.7507	0.0828	0.7507	0.8664
1.5483	0.3364	584	0.7510	0.0828	0.7510	0.8666
1.5483	0.3376	586	0.7523	0.0828	0.7523	0.8673
1.5483	0.3387	588	0.7576	0.0768	0.7576	0.8704
1.5483	0.3399	590	0.7849	0.0826	0.7849	0.8859
1.5483	0.3410	592	0.8206	0.0836	0.8206	0.9059
1.5483	0.3422	594	0.8530	0.0823	0.8530	0.9236
1.5483	0.3433	596	0.8445	0.0836	0.8445	0.9189
1.5483	0.3445	598	0.8211	0.0836	0.8211	0.9062
1.5483	0.3456	600	0.7977	0.0826	0.7977	0.8931
1.5483	0.3468	602	0.7779	0.0826	0.7779	0.8820
1.5483	0.3479	604	0.7760	0.0883	0.7760	0.8809
1.5483	0.3491	606	0.7846	0.0690	0.7846	0.8857
1.5483	0.3502	608	0.7825	0.0690	0.7825	0.8846
1.5483	0.3514	610	0.7733	0.0776	0.7733	0.8794
1.5483	0.3525	612	0.7722	0.0828	0.7722	0.8788
1.5483	0.3537	614	0.7986	0.0848	0.7986	0.8937
1.5483	0.3548	616	0.8534	0.0777	0.8534	0.9238
1.5483	0.3560	618	0.9058	0.0864	0.9058	0.9517
1.5483	0.3571	620	0.8982	0.0864	0.8982	0.9477
1.5483	0.3583	622	0.8426	0.0777	0.8426	0.9179
1.5483	0.3594	624	0.8160	0.0823	0.8160	0.9033
1.5483	0.3606	626	0.7988	0.0896	0.7988	0.8937
1.5483	0.3618	628	0.7905	0.0873	0.7905	0.8891
1.5483	0.3629	630	0.7916	0.0828	0.7916	0.8897
1.5483	0.3641	632	0.7993	0.0800	0.7993	0.8940
1.5483	0.3652	634	0.8152	0.0628	0.8152	0.9029
1.5483	0.3664	636	0.8148	0.0577	0.8148	0.9027
1.5483	0.3675	638	0.8155	0.0577	0.8155	0.9030
1.5483	0.3687	640	0.8309	0.0628	0.8309	0.9116
1.5483	0.3698	642	0.8296	0.0813	0.8296	0.9108
1.5483	0.3710	644	0.8401	0.0800	0.8401	0.9166
1.5483	0.3721	646	0.8523	0.0761	0.8523	0.9232
1.5483	0.3733	648	0.8509	0.0712	0.8509	0.9224
1.5483	0.3744	650	0.8534	0.0759	0.8534	0.9238
1.5483	0.3756	652	0.8300	0.0725	0.8300	0.9110
1.5483	0.3767	654	0.8092	0.0737	0.8092	0.8996

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1