bert-base-cased-mnli

This model is a fine-tuned version of bert-base-cased on the GLUE MNLI dataset. It achieves the following results on the evaluation set:

• Loss: 0.4392
• Accuracy: 0.8280

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 16
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• lr_scheduler_warmup_ratio: 0.06
• num_epochs: 10.0

Training results

Training Loss	Epoch	Step	Validation Loss	Accuracy
1.1127	0.02	500	1.0847	0.3851
1.0759	0.04	1000	1.0449	0.4540
1.006	0.06	1500	0.9296	0.5892
0.8848	0.08	2000	0.8357	0.6364
0.8063	0.1	2500	0.7549	0.6811
0.7527	0.12	3000	0.7219	0.6964
0.7259	0.14	3500	0.6928	0.7117
0.6822	0.16	4000	0.6547	0.7355
0.6826	0.18	4500	0.6424	0.7424
0.6625	0.2	5000	0.6370	0.7428
0.6676	0.22	5500	0.6116	0.7511
0.633	0.24	6000	0.6241	0.7526
0.629	0.26	6500	0.5994	0.7557
0.6161	0.29	7000	0.6057	0.7546
0.6003	0.31	7500	0.5514	0.7778
0.5847	0.33	8000	0.5475	0.7790
0.5747	0.35	8500	0.5481	0.7817
0.5579	0.37	9000	0.5356	0.7836
0.5719	0.39	9500	0.5311	0.7873
0.5666	0.41	10000	0.5242	0.7922
0.5586	0.43	10500	0.5295	0.7890
0.5604	0.45	11000	0.5239	0.7932
0.5511	0.47	11500	0.5271	0.7891
0.5379	0.49	12000	0.5082	0.8021
0.537	0.51	12500	0.5098	0.7983
0.5583	0.53	13000	0.5046	0.8011
0.5368	0.55	13500	0.5286	0.7937
0.5445	0.57	14000	0.5116	0.8009
0.5228	0.59	14500	0.5473	0.7912
0.5378	0.61	15000	0.4972	0.8030
0.5281	0.63	15500	0.4951	0.8068
0.5304	0.65	16000	0.5083	0.7989
0.539	0.67	16500	0.4953	0.8052
0.5189	0.69	17000	0.4962	0.8064
0.5241	0.71	17500	0.4939	0.8101
0.5128	0.73	18000	0.5054	0.8073
0.5074	0.75	18500	0.5074	0.8015
0.523	0.77	19000	0.4786	0.8144
0.5073	0.79	19500	0.4890	0.8131
0.4934	0.81	20000	0.4901	0.8104
0.5194	0.84	20500	0.4712	0.8147
0.5076	0.86	21000	0.4781	0.8109
0.5023	0.88	21500	0.4884	0.8132
0.5145	0.9	22000	0.4675	0.8159
0.5087	0.92	22500	0.4971	0.8041
0.499	0.94	23000	0.4767	0.8111
0.4964	0.96	23500	0.5074	0.8103
0.4992	0.98	24000	0.4786	0.8109
0.4936	1.0	24500	0.4812	0.8115
0.4122	1.02	25000	0.4860	0.8213
0.4022	1.04	25500	0.4916	0.8249
0.4028	1.06	26000	0.4567	0.8256
0.4023	1.08	26500	0.5356	0.7995
0.3888	1.1	27000	0.5084	0.8168
0.4084	1.12	27500	0.4924	0.8115
0.4108	1.14	28000	0.4779	0.8231
0.4175	1.16	28500	0.4759	0.8173
0.405	1.18	29000	0.4848	0.8174
0.4115	1.2	29500	0.4742	0.8163
0.4082	1.22	30000	0.5293	0.8139
0.4087	1.24	30500	0.4740	0.8214
0.3931	1.26	31000	0.4909	0.8204
0.4067	1.28	31500	0.4602	0.8248
0.4063	1.3	32000	0.4568	0.8252
0.4006	1.32	32500	0.4851	0.8209
0.4099	1.34	33000	0.4543	0.8295
0.4135	1.36	33500	0.4682	0.8268
0.4077	1.39	34000	0.4709	0.8241
0.4004	1.41	34500	0.4937	0.8231
0.4134	1.43	35000	0.4714	0.8250
0.4105	1.45	35500	0.4666	0.8256
0.4056	1.47	36000	0.4786	0.8240
0.4036	1.49	36500	0.4652	0.8254
0.4043	1.51	37000	0.4618	0.8274
0.4048	1.53	37500	0.4713	0.8294
0.4036	1.55	38000	0.4734	0.8265
0.4219	1.57	38500	0.4432	0.8295
0.3965	1.59	39000	0.4812	0.8230
0.4074	1.61	39500	0.4736	0.8251
0.4028	1.63	40000	0.4583	0.8261
0.3933	1.65	40500	0.4725	0.8284
0.4082	1.67	41000	0.4524	0.8270
0.415	1.69	41500	0.4564	0.8289
0.4177	1.71	42000	0.4635	0.8265
0.4093	1.73	42500	0.4488	0.8335
0.4117	1.75	43000	0.4690	0.8291
0.408	1.77	43500	0.4732	0.8203
0.4079	1.79	44000	0.4717	0.8277
0.4197	1.81	44500	0.4754	0.8259
0.4093	1.83	45000	0.4518	0.8315
0.4013	1.85	45500	0.4504	0.8308
0.3958	1.87	46000	0.4524	0.8281
0.4082	1.89	46500	0.4495	0.8305
0.4033	1.91	47000	0.4554	0.8272
0.4055	1.94	47500	0.4565	0.8266
0.398	1.96	48000	0.4699	0.8240
0.4044	1.98	48500	0.4459	0.8269
0.4023	2.0	49000	0.4623	0.8271
0.2913	2.02	49500	0.5247	0.8248
0.2915	2.04	50000	0.4998	0.8261
0.2675	2.06	50500	0.5703	0.8241
0.2708	2.08	51000	0.5629	0.8267
0.2802	2.1	51500	0.5333	0.8295
0.2847	2.12	52000	0.5118	0.8316
0.275	2.14	52500	0.5331	0.8279
0.2705	2.16	53000	0.5702	0.8186
0.2651	2.18	53500	0.5187	0.8301
0.2715	2.2	54000	0.5698	0.8230
0.2859	2.22	54500	0.5558	0.8287
0.2779	2.24	55000	0.5662	0.8303
0.2763	2.26	55500	0.5605	0.8246
0.2704	2.28	56000	0.5801	0.8310
0.2787	2.3	56500	0.5745	0.8224
0.3032	2.32	57000	0.5360	0.8252
0.282	2.34	57500	0.4963	0.8318
0.2921	2.36	58000	0.5654	0.8176
0.2934	2.38	58500	0.5242	0.8318
0.2788	2.4	59000	0.5904	0.8237
0.2897	2.42	59500	0.5342	0.8244
0.2795	2.44	60000	0.5495	0.8294
0.3001	2.46	60500	0.5422	0.8242
0.2831	2.49	61000	0.5394	0.8215
0.2925	2.51	61500	0.5181	0.8278
0.2886	2.53	62000	0.5727	0.8241
0.2983	2.55	62500	0.4796	0.8315
0.2897	2.57	63000	0.5624	0.8225
0.3107	2.59	63500	0.5108	0.8310
0.2994	2.61	64000	0.5153	0.8308
0.3015	2.63	64500	0.5199	0.8292
0.2973	2.65	65000	0.5756	0.8281
0.2997	2.67	65500	0.5135	0.8290
0.2987	2.69	66000	0.5447	0.8272
0.2874	2.71	66500	0.5268	0.8281
0.3095	2.73	67000	0.4899	0.8288
0.2992	2.75	67500	0.5107	0.8293
0.303	2.77	68000	0.5308	0.8280
0.3008	2.79	68500	0.5207	0.8330
0.3018	2.81	69000	0.5148	0.8265
0.3049	2.83	69500	0.5331	0.8285
0.3179	2.85	70000	0.4961	0.8310
0.3173	2.87	70500	0.5201	0.8319
0.2996	2.89	71000	0.5355	0.8349
0.2925	2.91	71500	0.5456	0.8291
0.3112	2.93	72000	0.4907	0.8316
0.306	2.95	72500	0.5189	0.8330
0.3043	2.97	73000	0.4903	0.8346
0.3133	2.99	73500	0.5277	0.8241
0.2258	3.01	74000	0.6482	0.8349
0.1931	3.04	74500	0.7001	0.8278
0.2004	3.06	75000	0.7123	0.8282
0.21	3.08	75500	0.6523	0.8230
0.1951	3.1	76000	0.6700	0.8328
0.2066	3.12	76500	0.6454	0.8245
0.2018	3.14	77000	0.6720	0.8329
0.2103	3.16	77500	0.6594	0.8272
0.2143	3.18	78000	0.6653	0.8287
0.21	3.2	78500	0.6134	0.8311
0.208	3.22	79000	0.7034	0.8337
0.211	3.24	79500	0.6400	0.8284
0.2127	3.26	80000	0.6509	0.8342
0.2181	3.28	80500	0.6740	0.8310
0.208	3.3	81000	0.6810	0.8306
0.215	3.32	81500	0.6483	0.8329
0.2112	3.34	82000	0.6621	0.8262
0.2241	3.36	82500	0.6127	0.8258
0.2128	3.38	83000	0.6406	0.8286
0.2375	3.4	83500	0.6295	0.8312
0.2147	3.42	84000	0.6305	0.8314
0.2342	3.44	84500	0.6310	0.8294
0.2286	3.46	85000	0.6614	0.8300
0.2108	3.48	85500	0.6604	0.8312
0.2288	3.5	86000	0.6229	0.8313
0.2249	3.52	86500	0.6229	0.8241
0.2191	3.54	87000	0.6363	0.8303
0.2229	3.57	87500	0.6613	0.8224
0.2252	3.59	88000	0.6487	0.8234
0.2248	3.61	88500	0.6279	0.8302
0.2227	3.63	89000	0.6609	0.8282
0.2175	3.65	89500	0.6393	0.8300
0.2126	3.67	90000	0.6208	0.8301
0.2222	3.69	90500	0.5796	0.8315
0.217	3.71	91000	0.6618	0.8327
0.2249	3.73	91500	0.6246	0.8326
0.2304	3.75	92000	0.5994	0.8328
0.2263	3.77	92500	0.6466	0.8280
0.2186	3.79	93000	0.6216	0.8265
0.2243	3.81	93500	0.6460	0.8220
0.2293	3.83	94000	0.6293	0.8242
0.2258	3.85	94500	0.6152	0.8303
0.2195	3.87	95000	0.6079	0.8275
0.2067	3.89	95500	0.6661	0.8235
0.2251	3.91	96000	0.6505	0.8268
0.233	3.93	96500	0.6256	0.8261
0.2406	3.95	97000	0.6000	0.8271
0.2119	3.97	97500	0.6684	0.8339
0.2368	3.99	98000	0.6182	0.8296
0.1768	4.01	98500	0.7741	0.8288
0.1459	4.03	99000	0.7897	0.8310
0.1538	4.05	99500	0.8029	0.8306
0.1507	4.07	100000	0.8052	0.8308
0.1703	4.09	100500	0.8227	0.8288
0.1602	4.12	101000	0.8112	0.8299
0.1616	4.14	101500	0.7852	0.8288
0.1689	4.16	102000	0.7107	0.8299
0.1506	4.18	102500	0.8631	0.8292
0.1725	4.2	103000	0.7750	0.8310
0.1553	4.22	103500	0.8073	0.8313
0.169	4.24	104000	0.7881	0.8345
0.1712	4.26	104500	0.7733	0.8292
0.1711	4.28	105000	0.7989	0.8302
0.1599	4.3	105500	0.7935	0.8265
0.1798	4.32	106000	0.7818	0.8269
0.179	4.34	106500	0.7610	0.8220
0.1655	4.36	107000	0.7380	0.8284
0.1751	4.38	107500	0.7645	0.8269
0.1831	4.4	108000	0.7583	0.8270
0.1659	4.42	108500	0.7804	0.8286
0.1622	4.44	109000	0.8106	0.8285
0.1892	4.46	109500	0.7328	0.8302
0.179	4.48	110000	0.7301	0.8270
0.169	4.5	110500	0.7589	0.8309
0.1781	4.52	111000	0.7714	0.8307
0.1772	4.54	111500	0.7736	0.8262
0.1706	4.56	112000	0.7867	0.8305
0.1747	4.58	112500	0.7819	0.8249
0.1814	4.6	113000	0.7312	0.8279
0.1778	4.62	113500	0.7775	0.8262
0.1816	4.64	114000	0.7786	0.8323
0.1848	4.67	114500	0.7804	0.8238
0.1787	4.69	115000	0.7459	0.8303
0.1613	4.71	115500	0.8105	0.8287
0.1864	4.73	116000	0.7469	0.8287
0.1838	4.75	116500	0.7508	0.8294
0.176	4.77	117000	0.7753	0.8294
0.1978	4.79	117500	0.7815	0.8284
0.1836	4.81	118000	0.7897	0.8225
0.1708	4.83	118500	0.8350	0.8270
0.1879	4.85	119000	0.7409	0.8285
0.1823	4.87	119500	0.7831	0.8289
0.19	4.89	120000	0.7433	0.8263
0.1845	4.91	120500	0.7195	0.8256
0.1829	4.93	121000	0.7550	0.8235
0.1729	4.95	121500	0.7562	0.8245
0.173	4.97	122000	0.7941	0.8276
0.1872	4.99	122500	0.7613	0.8304
0.1424	5.01	123000	0.8764	0.8258
0.1088	5.03	123500	0.9407	0.8303
0.1188	5.05	124000	0.9559	0.8290
0.1132	5.07	124500	0.9672	0.8213
0.1257	5.09	125000	0.9127	0.8291
0.1201	5.11	125500	1.0327	0.8226
0.1257	5.13	126000	0.9187	0.8272
0.1336	5.15	126500	0.8971	0.8291
0.1319	5.17	127000	0.9316	0.8256
0.133	5.19	127500	0.9140	0.8273
0.1294	5.22	128000	0.8752	0.8272
0.1315	5.24	128500	0.9288	0.8296
0.1234	5.26	129000	0.9681	0.8217
0.1232	5.28	129500	0.9213	0.8282
0.1309	5.3	130000	0.9321	0.8274
0.147	5.32	130500	0.8256	0.8340
0.1295	5.34	131000	0.9193	0.8246
0.1239	5.36	131500	0.9145	0.8335
0.1454	5.38	132000	0.8601	0.8294
0.1345	5.4	132500	0.9294	0.8301
0.1446	5.42	133000	0.8903	0.8299
0.14	5.44	133500	0.9664	0.8188
0.1412	5.46	134000	0.9688	0.8225
0.1393	5.48	134500	0.9102	0.8256
0.1487	5.5	135000	0.8585	0.8321
0.1363	5.52	135500	0.8892	0.8273
0.1388	5.54	136000	0.9253	0.8263
0.1286	5.56	136500	0.9117	0.8272
0.1406	5.58	137000	0.8725	0.8257
0.1377	5.6	137500	0.9155	0.8294
0.1407	5.62	138000	0.9327	0.8228
0.1308	5.64	138500	0.9619	0.8266
0.141	5.66	139000	0.9087	0.8290
0.1451	5.68	139500	0.9083	0.8258
0.1413	5.7	140000	0.9030	0.8253
0.1472	5.72	140500	0.8330	0.8311
0.1251	5.74	141000	0.9509	0.8239
0.1546	5.77	141500	0.8113	0.8301
0.1309	5.79	142000	0.9833	0.8238
0.1587	5.81	142500	0.8817	0.8263
0.1374	5.83	143000	0.8838	0.8273
0.1508	5.85	143500	0.8769	0.8308
0.1406	5.87	144000	0.8929	0.8309
0.1366	5.89	144500	0.9235	0.8301
0.1494	5.91	145000	0.8470	0.8289
0.1335	5.93	145500	0.9032	0.8300
0.1404	5.95	146000	0.8810	0.8306
0.1482	5.97	146500	0.9043	0.8278
0.1483	5.99	147000	0.9073	0.8283
0.1186	6.01	147500	0.9628	0.8271
0.078	6.03	148000	1.0228	0.8287
0.0917	6.05	148500	0.9993	0.8299
0.0898	6.07	149000	0.9852	0.8326
0.0971	6.09	149500	0.9814	0.8346
0.0882	6.11	150000	1.0538	0.8278
0.0829	6.13	150500	1.0677	0.8293
0.1079	6.15	151000	0.9678	0.8294
0.0904	6.17	151500	1.0365	0.8266
0.1016	6.19	152000	1.0043	0.8320
0.098	6.21	152500	0.9861	0.8321
0.0959	6.23	153000	0.9589	0.8350
0.096	6.25	153500	0.9867	0.8328
0.1019	6.27	154000	0.9825	0.8338
0.1065	6.29	154500	0.9864	0.8317
0.1077	6.32	155000	1.0051	0.8289
0.1035	6.34	155500	0.9882	0.8334
0.0873	6.36	156000	1.0419	0.8278
0.1019	6.38	156500	1.0334	0.8258
0.0993	6.4	157000	0.9954	0.8330
0.1116	6.42	157500	0.9941	0.8301
0.0996	6.44	158000	1.0413	0.8262
0.0987	6.46	158500	1.0250	0.8273
0.0968	6.48	159000	1.0690	0.8308
0.1145	6.5	159500	0.9717	0.8303
0.0991	6.52	160000	0.9853	0.8314
0.0997	6.54	160500	0.9904	0.8289
0.0984	6.56	161000	1.0008	0.8334
0.1092	6.58	161500	0.9623	0.8309
0.1035	6.6	162000	1.0328	0.8244
0.1156	6.62	162500	0.9976	0.8264
0.1067	6.64	163000	0.9704	0.8322
0.1139	6.66	163500	1.0199	0.8295
0.0948	6.68	164000	1.0384	0.8324
0.1092	6.7	164500	0.9703	0.8302
0.0987	6.72	165000	1.0323	0.8268
0.0918	6.74	165500	1.0378	0.8333
0.1062	6.76	166000	1.0150	0.8318
0.1069	6.78	166500	0.9688	0.8300
0.1046	6.8	167000	0.9943	0.8246
0.107	6.82	167500	0.9878	0.8296
0.0909	6.84	168000	1.0053	0.8287
0.1067	6.87	168500	0.9886	0.8270
0.1004	6.89	169000	0.9990	0.8296
0.0992	6.91	169500	1.0214	0.8291
0.1097	6.93	170000	1.0265	0.8242
0.1027	6.95	170500	1.0186	0.8286
0.1014	6.97	171000	0.9618	0.8286
0.0897	6.99	171500	1.0270	0.8318
0.087	7.01	172000	1.0727	0.8279
0.0598	7.03	172500	1.1137	0.8312
0.0641	7.05	173000	1.0740	0.8298
0.0614	7.07	173500	1.1526	0.8271
0.0589	7.09	174000	1.1481	0.8309
0.0624	7.11	174500	1.1475	0.8270
0.0679	7.13	175000	1.1185	0.8301
0.0618	7.15	175500	1.1509	0.8296
0.0765	7.17	176000	1.1362	0.8275
0.069	7.19	176500	1.1990	0.8298
0.0763	7.21	177000	1.1095	0.8292
0.0649	7.23	177500	1.1579	0.8266
0.0739	7.25	178000	1.1474	0.8299
0.0777	7.27	178500	1.0821	0.8333
0.0666	7.29	179000	1.1031	0.8311
0.0647	7.31	179500	1.1386	0.8292
0.0711	7.33	180000	1.1505	0.8271
0.0575	7.35	180500	1.1494	0.8263
0.0561	7.37	181000	1.2161	0.8270
0.0699	7.39	181500	1.1285	0.8310
0.0596	7.42	182000	1.1755	0.8291
0.0757	7.44	182500	1.1167	0.8330
0.0726	7.46	183000	1.1184	0.8298
0.0711	7.48	183500	1.1207	0.8310
0.07	7.5	184000	1.1214	0.8291
0.0819	7.52	184500	1.0905	0.8285
0.0647	7.54	185000	1.0851	0.8345
0.0814	7.56	185500	1.0697	0.8337
0.0764	7.58	186000	1.0697	0.8322
0.0701	7.6	186500	1.0965	0.8279
0.0651	7.62	187000	1.1121	0.8321
0.0683	7.64	187500	1.1246	0.8321
0.0682	7.66	188000	1.1285	0.8290
0.063	7.68	188500	1.1397	0.8327
0.0609	7.7	189000	1.1423	0.8306
0.0689	7.72	189500	1.1382	0.8349
0.0728	7.74	190000	1.1001	0.8380
0.0626	7.76	190500	1.1121	0.8319
0.0747	7.78	191000	1.0930	0.8288
0.0739	7.8	191500	1.0975	0.8307
0.0865	7.82	192000	1.0530	0.8309
0.0794	7.84	192500	1.0670	0.8302
0.0634	7.86	193000	1.0990	0.8348
0.0725	7.88	193500	1.1087	0.8325
0.0655	7.9	194000	1.0891	0.8360
0.0678	7.92	194500	1.1428	0.8262
0.0751	7.94	195000	1.1070	0.8326
0.0644	7.97	195500	1.1279	0.8347
0.0783	7.99	196000	1.0856	0.8357
0.0597	8.01	196500	1.1556	0.8335
0.0318	8.03	197000	1.2165	0.8292
0.0335	8.05	197500	1.2328	0.8308
0.0412	8.07	198000	1.2087	0.8293
0.0441	8.09	198500	1.2074	0.8360
0.048	8.11	199000	1.2072	0.8318
0.0402	8.13	199500	1.1964	0.8338
0.0553	8.15	200000	1.2450	0.8317
0.0391	8.17	200500	1.1994	0.8365
0.0428	8.19	201000	1.2593	0.8278
0.042	8.21	201500	1.2365	0.8280
0.0462	8.23	202000	1.2080	0.8294
0.0468	8.25	202500	1.2052	0.8309
0.0499	8.27	203000	1.1889	0.8314
0.0386	8.29	203500	1.1998	0.8344
0.0417	8.31	204000	1.2113	0.8306
0.0449	8.33	204500	1.2147	0.8308
0.0453	8.35	205000	1.2288	0.8298
0.0461	8.37	205500	1.2139	0.8298
0.0443	8.39	206000	1.2159	0.8305
0.0414	8.41	206500	1.2352	0.8314
0.0445	8.43	207000	1.2148	0.8317
0.0467	8.45	207500	1.2142	0.8317
0.0412	8.47	208000	1.2305	0.8326
0.0488	8.49	208500	1.2000	0.8307
0.0398	8.52	209000	1.2434	0.8308
0.0376	8.54	209500	1.2225	0.8347
0.0384	8.56	210000	1.2458	0.8322
0.0427	8.58	210500	1.2666	0.8299
0.046	8.6	211000	1.2675	0.8326
0.0482	8.62	211500	1.2514	0.8313
0.0428	8.64	212000	1.2442	0.8309
0.0398	8.66	212500	1.2553	0.8331
0.0467	8.68	213000	1.2608	0.8303
0.0355	8.7	213500	1.2646	0.8313
0.039	8.72	214000	1.2498	0.8329
0.0395	8.74	214500	1.2579	0.8329
0.0405	8.76	215000	1.2702	0.8326
0.0401	8.78	215500	1.2618	0.8326
0.0483	8.8	216000	1.2525	0.8300
0.0421	8.82	216500	1.2417	0.8349
0.0379	8.84	217000	1.2829	0.8275
0.0377	8.86	217500	1.2609	0.8327
0.0437	8.88	218000	1.2576	0.8306
0.0473	8.9	218500	1.2613	0.8304
0.041	8.92	219000	1.2588	0.8312
0.0455	8.94	219500	1.2495	0.8303
0.0439	8.96	220000	1.2259	0.8328
0.0445	8.98	220500	1.2252	0.8303
0.0475	9.0	221000	1.2289	0.8304
0.0292	9.02	221500	1.2341	0.8332
0.0273	9.04	222000	1.2633	0.8332
0.0211	9.07	222500	1.3210	0.8291
0.0183	9.09	223000	1.3403	0.8299
0.0323	9.11	223500	1.3470	0.8290
0.0287	9.13	224000	1.3351	0.8318
0.0316	9.15	224500	1.3348	0.8301
0.0314	9.17	225000	1.3089	0.8339
0.0227	9.19	225500	1.3239	0.8329
0.0322	9.21	226000	1.3147	0.8326
0.0266	9.23	226500	1.3301	0.8325
0.0296	9.25	227000	1.3318	0.8324
0.0267	9.27	227500	1.3228	0.8341
0.0258	9.29	228000	1.3154	0.8344
0.0275	9.31	228500	1.3212	0.8324
0.0242	9.33	229000	1.3314	0.8349
0.0193	9.35	229500	1.3317	0.8349
0.0241	9.37	230000	1.3180	0.8341
0.0255	9.39	230500	1.3172	0.8348
0.0193	9.41	231000	1.3233	0.8354
0.0235	9.43	231500	1.3447	0.8321
0.0241	9.45	232000	1.3474	0.8325
0.024	9.47	232500	1.3381	0.8333
0.0261	9.49	233000	1.3319	0.8333
0.026	9.51	233500	1.3453	0.8327
0.0264	9.53	234000	1.3304	0.8345
0.0308	9.55	234500	1.3235	0.8338
0.0226	9.57	235000	1.3160	0.8347
0.0293	9.6	235500	1.3122	0.8330
0.0256	9.62	236000	1.3295	0.8331
0.0325	9.64	236500	1.3268	0.8310
0.0281	9.66	237000	1.3304	0.8321
0.0228	9.68	237500	1.3326	0.8318
0.03	9.7	238000	1.3234	0.8321
0.029	9.72	238500	1.3354	0.8324
0.0212	9.74	239000	1.3303	0.8336
0.0199	9.76	239500	1.3393	0.8330
0.0254	9.78	240000	1.3396	0.8327
0.0237	9.8	240500	1.3355	0.8336
0.0229	9.82	241000	1.3368	0.8342
0.0251	9.84	241500	1.3388	0.8329
0.0255	9.86	242000	1.3362	0.8337
0.0206	9.88	242500	1.3369	0.8341
0.0352	9.9	243000	1.3408	0.8330
0.0201	9.92	243500	1.3358	0.8330
0.0252	9.94	244000	1.3379	0.8332
0.0294	9.96	244500	1.3330	0.8337
0.0222	9.98	245000	1.3340	0.8336

Framework versions

• Transformers 4.21.3
• Pytorch 1.7.1
• Datasets 1.18.3
• Tokenizers 0.11.6