segformer-b4-ade-finetuned-512-512-finetuned-grCoastline_512

This model is a fine-tuned version of nvidia/segformer-b4-finetuned-ade-512-512 on the peldrak/grCoastline_512 dataset. It achieves the following results on the evaluation set:

• Loss: 0.3485
• Mean Iou: 0.7745
• Mean Accuracy: 0.8460
• Overall Accuracy: 0.9397
• Accuracy Water: 0.9854
• Accuracy Whitewater: 0.5267
• Accuracy Sediment: 0.9100
• Accuracy Other Natural Terrain: 0.7714
• Accuracy Vegetation: 0.9143
• Accuracy Development: 0.8156
• Accuracy Unknown: 0.9987
• Iou Water: 0.9657
• Iou Whitewater: 0.4461
• Iou Sediment: 0.8412
• Iou Other Natural Terrain: 0.6769
• Iou Vegetation: 0.7892
• Iou Development: 0.7052
• Iou Unknown: 0.9973

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 6e-05
• train_batch_size: 4
• eval_batch_size: 4
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 40

Training results

Training Loss	Epoch	Step	Validation Loss	Mean Iou	Mean Accuracy	Overall Accuracy	Accuracy Water	Accuracy Whitewater	Accuracy Sediment	Accuracy Other Natural Terrain	Accuracy Vegetation	Accuracy Development	Accuracy Unknown	Iou Water	Iou Whitewater	Iou Sediment	Iou Other Natural Terrain	Iou Vegetation	Iou Development	Iou Unknown
1.4715	0.24	20	1.3366	0.4971	0.6028	0.8289	0.8428	0.0	0.7635	0.5946	0.8680	0.1720	0.9787	0.7080	0.0	0.5497	0.5015	0.5871	0.1572	0.9761
1.0643	0.49	40	0.8194	0.5046	0.6044	0.8506	0.9722	0.0	0.8982	0.4334	0.8951	0.0386	0.9935	0.7889	0.0	0.7048	0.3646	0.6444	0.0384	0.9912
1.1372	0.73	60	0.6288	0.5104	0.6150	0.8513	0.9722	0.0	0.9217	0.4078	0.8554	0.1517	0.9959	0.7840	0.0	0.5960	0.3498	0.7041	0.1494	0.9897
1.2667	0.98	80	0.4994	0.5638	0.6526	0.8825	0.9793	0.0	0.9053	0.5839	0.9205	0.1807	0.9984	0.8893	0.0	0.6812	0.5051	0.7026	0.1783	0.9903
0.8003	1.22	100	0.4520	0.5522	0.6421	0.8767	0.9719	0.0	0.9220	0.5197	0.9549	0.1324	0.9942	0.9218	0.0	0.7007	0.4562	0.6631	0.1315	0.9917
0.6688	1.46	120	0.4432	0.5528	0.6399	0.8774	0.9726	0.0	0.8860	0.5450	0.9650	0.1153	0.9955	0.9121	0.0	0.7111	0.4820	0.6572	0.1149	0.9921
0.7934	1.71	140	0.3905	0.6088	0.6882	0.8968	0.9406	0.0	0.7654	0.8742	0.8782	0.3614	0.9979	0.8728	0.0	0.7087	0.6021	0.7469	0.3397	0.9914
0.6258	1.95	160	0.3358	0.6410	0.7105	0.9126	0.9753	0.0	0.8484	0.7994	0.9134	0.4395	0.9977	0.9140	0.0	0.7937	0.6252	0.7544	0.4076	0.9924
0.4741	2.2	180	0.3298	0.6339	0.7070	0.9115	0.9715	0.0	0.9195	0.7328	0.9316	0.3962	0.9971	0.9326	0.0	0.7588	0.6403	0.7344	0.3787	0.9926
1.1083	2.44	200	0.2815	0.6686	0.7348	0.9217	0.9554	0.0	0.8974	0.7519	0.9370	0.6029	0.9990	0.9269	0.0	0.8030	0.6504	0.7567	0.5518	0.9912
0.2948	2.68	220	0.3011	0.6636	0.7362	0.9187	0.9852	0.0	0.7992	0.7347	0.9271	0.7136	0.9935	0.9241	0.0	0.7458	0.6579	0.7534	0.5726	0.9914
0.2183	2.93	240	0.2771	0.6775	0.7451	0.9235	0.9840	0.0	0.8966	0.6596	0.9337	0.7454	0.9966	0.9334	0.0	0.7904	0.6217	0.7482	0.6564	0.9922
0.1911	3.17	260	0.2561	0.6791	0.7506	0.9240	0.9807	0.0	0.8817	0.8266	0.8373	0.7304	0.9974	0.9228	0.0	0.8090	0.6484	0.7604	0.6190	0.9944
0.3457	3.41	280	0.2194	0.6919	0.7642	0.9311	0.9774	0.0	0.8939	0.9032	0.8159	0.7615	0.9975	0.9484	0.0	0.8097	0.7083	0.7685	0.6141	0.9942
0.2098	3.66	300	0.2858	0.6620	0.7319	0.9185	0.9742	0.0	0.9149	0.6644	0.9326	0.6386	0.9985	0.9503	0.0	0.7779	0.5936	0.7397	0.5780	0.9942
0.6556	3.9	320	0.2265	0.6824	0.7512	0.9263	0.9779	0.0	0.9237	0.8318	0.8446	0.6831	0.9971	0.9465	0.0	0.8176	0.6572	0.7500	0.6113	0.9940
0.4157	4.15	340	0.2339	0.6836	0.7573	0.9252	0.9802	0.0	0.9133	0.7874	0.8292	0.7922	0.9984	0.9434	0.0	0.8170	0.6560	0.7348	0.6417	0.9924
0.4104	4.39	360	0.2441	0.6896	0.7593	0.9293	0.9763	0.0	0.9323	0.7923	0.8774	0.7438	0.9930	0.9313	0.0	0.8156	0.6714	0.7766	0.6404	0.9921
0.2119	4.63	380	0.2272	0.6863	0.7540	0.9291	0.9842	0.0	0.9231	0.7755	0.8810	0.7168	0.9977	0.9304	0.0	0.8128	0.6666	0.7776	0.6220	0.9944
0.3009	4.88	400	0.2231	0.6931	0.7598	0.9314	0.9807	0.0	0.9065	0.7653	0.8970	0.7710	0.9979	0.9526	0.0	0.8193	0.6725	0.7653	0.6477	0.9943
0.1716	5.12	420	0.2095	0.6985	0.7675	0.9342	0.9757	0.0	0.8680	0.8194	0.8927	0.8204	0.9965	0.9522	0.0	0.7944	0.7061	0.7876	0.6548	0.9943
0.1558	5.37	440	0.2252	0.6895	0.7561	0.9312	0.9824	0.0	0.8594	0.8082	0.9130	0.7348	0.9951	0.9245	0.0	0.8017	0.6848	0.8102	0.6118	0.9935
0.1676	5.61	460	0.2248	0.6910	0.7673	0.9309	0.9748	0.0	0.8889	0.8280	0.8465	0.8361	0.9971	0.9442	0.0	0.7857	0.7080	0.7802	0.6238	0.9950
0.1709	5.85	480	0.2455	0.6937	0.7573	0.9327	0.9739	0.0	0.9177	0.7953	0.9107	0.7058	0.9975	0.9538	0.0	0.8189	0.6807	0.7747	0.6323	0.9956
0.3403	6.1	500	0.2661	0.6862	0.7528	0.9298	0.9821	0.0	0.9366	0.7061	0.9308	0.7172	0.9967	0.9161	0.0	0.8040	0.6597	0.7971	0.6315	0.9948
0.2134	6.34	520	0.2447	0.6857	0.7522	0.9310	0.9757	0.0	0.9248	0.8739	0.8677	0.6256	0.9977	0.9368	0.0	0.8059	0.6996	0.7921	0.5703	0.9953
0.2108	6.59	540	0.2575	0.6868	0.7574	0.9277	0.9824	0.0	0.9024	0.7638	0.8811	0.7776	0.9946	0.9476	0.0	0.8100	0.6565	0.7566	0.6439	0.9931
0.2009	6.83	560	0.2191	0.7008	0.7625	0.9362	0.9839	0.0	0.8759	0.8257	0.9155	0.7399	0.9967	0.9362	0.0	0.8088	0.7217	0.8005	0.6438	0.9946
0.1056	7.07	580	0.2391	0.6950	0.7571	0.9339	0.9793	0.0	0.9294	0.7612	0.9302	0.7020	0.9974	0.9495	0.0	0.8024	0.6891	0.7857	0.6439	0.9947
0.1038	7.32	600	0.2415	0.6921	0.7598	0.9311	0.9821	0.0	0.9165	0.7571	0.8915	0.7730	0.9982	0.9450	0.0	0.8143	0.6651	0.7725	0.6526	0.9950
0.4394	7.56	620	0.2763	0.6891	0.7597	0.9281	0.9686	0.0	0.8743	0.7862	0.8842	0.8074	0.9970	0.9424	0.0	0.8110	0.6664	0.7543	0.6549	0.9950
0.2996	7.8	640	0.2946	0.7019	0.7650	0.9346	0.9868	0.0	0.8923	0.7386	0.9290	0.8131	0.9953	0.9532	0.0	0.8276	0.6724	0.7729	0.6929	0.9943
0.1253	8.05	660	0.2495	0.7061	0.7659	0.9381	0.9803	0.0	0.9227	0.7637	0.9341	0.7618	0.9985	0.9558	0.0	0.8267	0.6985	0.7890	0.6769	0.9959
0.1667	8.29	680	0.2619	0.7000	0.7624	0.9356	0.9870	0.0	0.9419	0.7868	0.9021	0.7228	0.9965	0.9519	0.0	0.8224	0.6895	0.7855	0.6554	0.9954
0.2411	8.54	700	0.2650	0.6945	0.7599	0.9319	0.9841	0.0	0.9103	0.7808	0.8906	0.7563	0.9971	0.9538	0.0	0.8257	0.6670	0.7658	0.6537	0.9953
0.0618	8.78	720	0.2791	0.6958	0.7612	0.9323	0.9846	0.0	0.9110	0.7900	0.8929	0.7549	0.9947	0.9507	0.0	0.8265	0.6742	0.7708	0.6544	0.9938
0.3955	9.02	740	0.2605	0.6973	0.7678	0.9329	0.9833	0.0	0.8551	0.7686	0.8970	0.8734	0.9972	0.9309	0.0	0.8111	0.6795	0.7933	0.6713	0.9952
0.1222	9.27	760	0.3107	0.6889	0.7515	0.9302	0.9839	0.0	0.9143	0.7856	0.9042	0.6760	0.9968	0.9551	0.0	0.8226	0.6597	0.7625	0.6266	0.9955
0.1179	9.51	780	0.2867	0.6988	0.7651	0.9329	0.9810	0.0	0.9059	0.7761	0.8890	0.8069	0.9969	0.9544	0.0	0.8335	0.6615	0.7678	0.6791	0.9955
0.1552	9.76	800	0.2837	0.6905	0.7528	0.9313	0.9863	0.0	0.9165	0.7775	0.9105	0.6815	0.9970	0.9520	0.0	0.8224	0.6600	0.7745	0.6299	0.9949
0.0762	10.0	820	0.2756	0.7050	0.7682	0.9361	0.9786	0.0	0.9304	0.7674	0.9024	0.8000	0.9984	0.9552	0.0	0.8306	0.6760	0.7779	0.6998	0.9954
0.0641	10.24	840	0.2555	0.7081	0.7697	0.9373	0.9786	0.0	0.9068	0.7760	0.9134	0.8147	0.9983	0.9544	0.0	0.8366	0.6825	0.7816	0.7059	0.9957
0.1294	10.49	860	0.2671	0.6987	0.7599	0.9336	0.9865	0.0	0.8976	0.7942	0.9003	0.7429	0.9978	0.9498	0.0	0.8382	0.6635	0.7767	0.6669	0.9958
0.0948	10.73	880	0.2697	0.6969	0.7693	0.9318	0.9753	0.0	0.9242	0.7797	0.8536	0.8534	0.9987	0.9501	0.0	0.8246	0.6679	0.7616	0.6787	0.9956
0.1013	10.98	900	0.2956	0.6931	0.7573	0.9321	0.9885	0.0	0.9132	0.8039	0.8866	0.7121	0.9966	0.9519	0.0	0.8242	0.6681	0.7760	0.6357	0.9956
0.1085	11.22	920	0.2849	0.7058	0.7714	0.9359	0.9893	0.0	0.8995	0.7545	0.8977	0.8616	0.9969	0.9556	0.0	0.8445	0.6664	0.7752	0.7033	0.9956
0.0805	11.46	940	0.3072	0.6998	0.7662	0.9333	0.9777	0.0	0.8816	0.7738	0.9020	0.8309	0.9973	0.9570	0.0	0.8242	0.6621	0.7718	0.6877	0.9957
0.1627	11.71	960	0.2815	0.7008	0.7608	0.9346	0.9895	0.0	0.9083	0.7872	0.9032	0.7397	0.9976	0.9534	0.0	0.8419	0.6661	0.7739	0.6743	0.9960
0.0728	11.95	980	0.3182	0.6968	0.7611	0.9325	0.9789	0.0	0.9230	0.7933	0.8883	0.7476	0.9969	0.9570	0.0	0.8308	0.6558	0.7697	0.6684	0.9961
0.078	12.2	1000	0.2794	0.7036	0.7688	0.9349	0.9842	0.0	0.9117	0.7724	0.8858	0.8290	0.9983	0.9538	0.0	0.8378	0.6639	0.7725	0.7010	0.9962
0.0962	12.44	1020	0.2778	0.7023	0.7618	0.9357	0.9830	0.0016	0.9060	0.7851	0.9184	0.7402	0.9985	0.9533	0.0016	0.8370	0.6728	0.7826	0.6724	0.9965
0.0621	12.68	1040	0.2452	0.7029	0.7639	0.9360	0.9855	0.0	0.9187	0.8156	0.8879	0.7406	0.9988	0.9538	0.0	0.8374	0.6806	0.7827	0.6695	0.9961
0.114	12.93	1060	0.2496	0.7090	0.7703	0.9390	0.9852	0.0	0.9259	0.7787	0.9130	0.7912	0.9979	0.9554	0.0	0.8333	0.6915	0.7959	0.6904	0.9962
0.0747	13.17	1080	0.2531	0.7038	0.7656	0.9369	0.9820	0.0	0.9245	0.8319	0.8851	0.7371	0.9985	0.9543	0.0	0.8339	0.6898	0.7919	0.6609	0.9957
0.0535	13.41	1100	0.2763	0.7113	0.7728	0.9391	0.9832	0.0	0.9017	0.7641	0.9231	0.8398	0.9978	0.9549	0.0	0.8403	0.6872	0.7908	0.7099	0.9959
0.0538	13.66	1120	0.2819	0.7020	0.7662	0.9355	0.9854	0.0	0.9113	0.7951	0.8927	0.7817	0.9971	0.9505	0.0	0.8276	0.6783	0.7863	0.6752	0.9962
0.0953	13.9	1140	0.2945	0.7000	0.7616	0.9347	0.9839	0.0	0.9208	0.7676	0.9141	0.7474	0.9975	0.9556	0.0	0.8339	0.6660	0.7777	0.6703	0.9963
0.1052	14.15	1160	0.3095	0.6944	0.7566	0.9331	0.9859	0.0000	0.9257	0.7770	0.9067	0.7023	0.9982	0.9564	0.0000	0.8287	0.6599	0.7790	0.6406	0.9963
0.0879	14.39	1180	0.2800	0.7084	0.7724	0.9372	0.9864	0.0006	0.9166	0.7625	0.8991	0.8443	0.9973	0.9561	0.0006	0.8483	0.6707	0.7806	0.7064	0.9958
0.1387	14.63	1200	0.2951	0.7115	0.7741	0.9363	0.9825	0.0384	0.9211	0.7941	0.8873	0.7972	0.9982	0.9595	0.0383	0.8431	0.6666	0.7776	0.6990	0.9963
0.2297	14.88	1220	0.3029	0.7035	0.7635	0.9363	0.9882	0.0009	0.9185	0.7519	0.9243	0.7628	0.9981	0.9537	0.0009	0.8377	0.6681	0.7840	0.6838	0.9963
0.0713	15.12	1240	0.2940	0.7232	0.7852	0.9380	0.9879	0.1042	0.8996	0.7752	0.9104	0.8218	0.9974	0.9600	0.1029	0.8405	0.6757	0.7867	0.7003	0.9962
0.0909	15.37	1260	0.2922	0.7233	0.7846	0.9371	0.9820	0.1383	0.9264	0.7661	0.9219	0.7598	0.9981	0.9589	0.1356	0.8298	0.6753	0.7886	0.6786	0.9966
0.0336	15.61	1280	0.2995	0.7155	0.7758	0.9367	0.9891	0.0878	0.9176	0.7913	0.9071	0.7396	0.9979	0.9565	0.0854	0.8376	0.6727	0.7890	0.6709	0.9964
0.1919	15.85	1300	0.2794	0.7271	0.7880	0.9393	0.9827	0.1148	0.9229	0.7685	0.9148	0.8133	0.9988	0.9577	0.1123	0.8422	0.6828	0.7899	0.7087	0.9963
0.1494	16.1	1320	0.3131	0.7285	0.7895	0.9375	0.9858	0.1660	0.9179	0.7783	0.9150	0.7654	0.9978	0.9603	0.1615	0.8331	0.6788	0.7865	0.6827	0.9965
0.0559	16.34	1340	0.3163	0.7314	0.7925	0.9376	0.9834	0.1874	0.9244	0.7683	0.9205	0.7657	0.9981	0.9597	0.1813	0.8335	0.6762	0.7878	0.6846	0.9967
0.0675	16.59	1360	0.3053	0.7238	0.7866	0.9356	0.9866	0.1591	0.9287	0.8038	0.8834	0.7465	0.9983	0.9593	0.1527	0.8366	0.6695	0.7782	0.6733	0.9969
0.0999	16.83	1380	0.2811	0.7283	0.7878	0.9390	0.9841	0.1288	0.9217	0.7675	0.9173	0.7957	0.9994	0.9592	0.1254	0.8404	0.6818	0.7867	0.7083	0.9961
0.0321	17.07	1400	0.3063	0.7335	0.7965	0.9373	0.9857	0.1924	0.9164	0.7917	0.8896	0.8007	0.9988	0.9599	0.1806	0.8428	0.6686	0.7805	0.7052	0.9969
0.1219	17.32	1420	0.3262	0.7209	0.7820	0.9354	0.9855	0.1616	0.9346	0.7688	0.9175	0.7074	0.9985	0.9587	0.1578	0.8217	0.6706	0.7852	0.6552	0.9969
0.0637	17.56	1440	0.3415	0.7331	0.7938	0.9379	0.9874	0.1945	0.9184	0.7516	0.9269	0.7789	0.9985	0.9607	0.1848	0.8401	0.6685	0.7870	0.6937	0.9968
0.183	17.8	1460	0.3183	0.7403	0.8019	0.9381	0.9842	0.2370	0.9312	0.7719	0.9064	0.7836	0.9991	0.9626	0.2256	0.8413	0.6737	0.7818	0.7009	0.9965
0.0783	18.05	1480	0.3003	0.7481	0.8096	0.9396	0.9827	0.2663	0.9208	0.7452	0.9282	0.8255	0.9986	0.9648	0.2526	0.8468	0.6734	0.7831	0.7192	0.9970
0.1254	18.29	1500	0.3088	0.7317	0.7921	0.9373	0.9880	0.2074	0.9196	0.7615	0.9285	0.7413	0.9984	0.9628	0.1987	0.8281	0.6746	0.7877	0.6736	0.9968
0.0438	18.54	1520	0.3166	0.7430	0.8087	0.9373	0.9827	0.2761	0.8887	0.7908	0.9066	0.8186	0.9976	0.9639	0.2588	0.8243	0.6753	0.7890	0.6931	0.9966
0.06	18.78	1540	0.3152	0.7472	0.8138	0.9371	0.9862	0.3188	0.8854	0.7848	0.9059	0.8171	0.9981	0.9626	0.2963	0.8203	0.6789	0.7871	0.6883	0.9968
0.0426	19.02	1560	0.3289	0.7438	0.8098	0.9362	0.9830	0.3040	0.8962	0.7911	0.9009	0.7953	0.9981	0.9639	0.2836	0.8180	0.6722	0.7831	0.6885	0.9972
0.0333	19.27	1580	0.3027	0.7387	0.8038	0.9375	0.9842	0.2482	0.8965	0.7879	0.9063	0.8050	0.9983	0.9625	0.2332	0.8212	0.6809	0.7886	0.6868	0.9973
0.044	19.51	1600	0.3048	0.7386	0.8002	0.9387	0.9865	0.2334	0.9183	0.7811	0.9175	0.7664	0.9983	0.9607	0.2165	0.8341	0.6816	0.7914	0.6890	0.9971
0.0876	19.76	1620	0.2864	0.7563	0.8204	0.9401	0.9835	0.3356	0.9230	0.7849	0.9065	0.8113	0.9985	0.9645	0.3109	0.8376	0.6865	0.7905	0.7072	0.9971
0.0432	20.0	1640	0.3037	0.7480	0.8111	0.9382	0.9856	0.3087	0.9147	0.7628	0.9219	0.7857	0.9984	0.9637	0.2853	0.8319	0.6757	0.7849	0.6977	0.9972
0.1937	20.24	1660	0.3050	0.7495	0.8149	0.9368	0.9852	0.3424	0.9162	0.7638	0.9086	0.7893	0.9989	0.9630	0.3114	0.8323	0.6671	0.7782	0.6978	0.9969
0.0361	20.49	1680	0.3204	0.7553	0.8221	0.9380	0.9846	0.3646	0.9083	0.7738	0.9064	0.8188	0.9979	0.9636	0.3276	0.8381	0.6715	0.7813	0.7085	0.9970
0.1199	20.73	1700	0.3165	0.7572	0.8218	0.9400	0.9873	0.3352	0.9105	0.7428	0.9204	0.8581	0.9986	0.9642	0.3088	0.8400	0.6760	0.7842	0.7302	0.9971
0.0564	20.98	1720	0.3132	0.7561	0.8199	0.9397	0.9821	0.3483	0.9140	0.7492	0.9344	0.8129	0.9986	0.9631	0.3137	0.8348	0.6799	0.7879	0.7164	0.9971
0.0598	21.22	1740	0.3061	0.7511	0.8144	0.9399	0.9889	0.3005	0.9115	0.7575	0.9219	0.8219	0.9984	0.9630	0.2700	0.8384	0.6792	0.7874	0.7228	0.9971
0.046	21.46	1760	0.3253	0.7429	0.8072	0.9359	0.9847	0.3337	0.9198	0.7560	0.9298	0.7273	0.9987	0.9630	0.3009	0.8273	0.6668	0.7833	0.6625	0.9968
0.0445	21.71	1780	0.3066	0.7553	0.8234	0.9377	0.9840	0.3722	0.9179	0.7741	0.9034	0.8151	0.9970	0.9637	0.3362	0.8364	0.6700	0.7859	0.6981	0.9964
0.0319	21.95	1800	0.2987	0.7557	0.8219	0.9383	0.9826	0.3776	0.9244	0.7681	0.9151	0.7867	0.9984	0.9653	0.3414	0.8323	0.6704	0.7900	0.6936	0.9972
0.0618	22.2	1820	0.3117	0.7561	0.8216	0.9393	0.9881	0.3721	0.9045	0.7756	0.9193	0.7927	0.9986	0.9647	0.3263	0.8346	0.6793	0.7907	0.6997	0.9972
0.0648	22.44	1840	0.3060	0.7560	0.8229	0.9388	0.9856	0.3763	0.9219	0.7655	0.9124	0.8000	0.9988	0.9639	0.3345	0.8326	0.6758	0.7895	0.6985	0.9973
0.0797	22.68	1860	0.3263	0.7554	0.8208	0.9377	0.9827	0.3870	0.9216	0.7785	0.9135	0.7631	0.9987	0.9627	0.3487	0.8298	0.6744	0.7863	0.6886	0.9974
0.1237	22.93	1880	0.3307	0.7485	0.8114	0.9392	0.9884	0.3037	0.9067	0.7530	0.9316	0.7979	0.9987	0.9618	0.2721	0.8339	0.6789	0.7890	0.7067	0.9970
0.1067	23.17	1900	0.3474	0.7529	0.8184	0.9373	0.9817	0.3705	0.9195	0.7855	0.9099	0.7639	0.9982	0.9632	0.3348	0.8316	0.6730	0.7849	0.6853	0.9972
0.0712	23.41	1920	0.3343	0.7541	0.8183	0.9385	0.9859	0.3507	0.9117	0.7823	0.9149	0.7855	0.9970	0.9633	0.3194	0.8392	0.6755	0.7876	0.6974	0.9965
0.0899	23.66	1940	0.3323	0.7533	0.8188	0.9389	0.9847	0.3440	0.9164	0.7552	0.9246	0.8087	0.9978	0.9628	0.3066	0.8374	0.6754	0.7868	0.7075	0.9969
0.0317	23.9	1960	0.3198	0.7618	0.8313	0.9374	0.9849	0.4468	0.9193	0.7863	0.8964	0.7872	0.9984	0.9644	0.3890	0.8393	0.6682	0.7815	0.6928	0.9973
0.0285	24.15	1980	0.3128	0.7596	0.8264	0.9378	0.9851	0.4220	0.9104	0.7717	0.9158	0.7810	0.9986	0.9640	0.3708	0.8387	0.6694	0.7830	0.6944	0.9971
0.0486	24.39	2000	0.3437	0.7630	0.8306	0.9386	0.9822	0.4286	0.9020	0.7792	0.9146	0.8095	0.9984	0.9642	0.3776	0.8381	0.6761	0.7856	0.7021	0.9971
0.0316	24.63	2020	0.3405	0.7544	0.8216	0.9370	0.9844	0.3825	0.9102	0.7801	0.9019	0.7935	0.9987	0.9634	0.3421	0.8381	0.6681	0.7806	0.6912	0.9970
0.0578	24.88	2040	0.3236	0.7546	0.8199	0.9375	0.9852	0.3842	0.9154	0.7651	0.9180	0.7719	0.9992	0.9628	0.3424	0.8374	0.6677	0.7841	0.6912	0.9969
0.0508	25.12	2060	0.3100	0.7602	0.8293	0.9381	0.9860	0.4213	0.9127	0.7742	0.9023	0.8093	0.9991	0.9647	0.3667	0.8409	0.6696	0.7843	0.6979	0.9970
0.1105	25.37	2080	0.3355	0.7627	0.8309	0.9385	0.9833	0.4328	0.9249	0.7711	0.9098	0.7957	0.9983	0.9647	0.3824	0.8389	0.6719	0.7872	0.6967	0.9971
0.0606	25.61	2100	0.3244	0.7614	0.8294	0.9383	0.9857	0.4365	0.9214	0.7704	0.9122	0.7807	0.9989	0.9642	0.3811	0.8372	0.6716	0.7884	0.6905	0.9968
0.0617	25.85	2120	0.3365	0.7631	0.8326	0.9379	0.9844	0.4610	0.9217	0.7764	0.9067	0.7792	0.9989	0.9646	0.4002	0.8362	0.6713	0.7871	0.6853	0.9968
0.0475	26.1	2140	0.3276	0.7625	0.8293	0.9389	0.9836	0.4334	0.9154	0.7779	0.9191	0.7777	0.9984	0.9635	0.3804	0.8365	0.6807	0.7890	0.6902	0.9970
0.0273	26.34	2160	0.3273	0.7619	0.8280	0.9395	0.9861	0.4197	0.9042	0.7734	0.9250	0.7885	0.9989	0.9625	0.3677	0.8352	0.6845	0.7922	0.6943	0.9968
0.032	26.59	2180	0.3212	0.7663	0.8346	0.9389	0.9860	0.4738	0.9158	0.7828	0.9155	0.7700	0.9983	0.9636	0.4117	0.8346	0.6795	0.7925	0.6848	0.9971
0.0506	26.83	2200	0.3258	0.7628	0.8333	0.9381	0.9853	0.4548	0.9100	0.7921	0.9009	0.7919	0.9981	0.9641	0.3927	0.8347	0.6766	0.7885	0.6862	0.9970
0.0514	27.07	2220	0.3247	0.7611	0.8285	0.9381	0.9859	0.4388	0.9098	0.7799	0.9138	0.7724	0.9990	0.9636	0.3842	0.8339	0.6749	0.7888	0.6857	0.9969
0.0586	27.32	2240	0.3425	0.7694	0.8395	0.9383	0.9817	0.5045	0.9230	0.7765	0.9132	0.7790	0.9983	0.9647	0.4356	0.8357	0.6748	0.7871	0.6906	0.9971
0.0358	27.56	2260	0.3287	0.7649	0.8334	0.9387	0.9853	0.4549	0.9222	0.7742	0.9103	0.7880	0.9986	0.9651	0.3982	0.8369	0.6744	0.7883	0.6941	0.9973
0.081	27.8	2280	0.3187	0.7564	0.8199	0.9394	0.9879	0.3687	0.9101	0.7757	0.9257	0.7730	0.9979	0.9634	0.3317	0.8395	0.6810	0.7917	0.6905	0.9971
0.0626	28.05	2300	0.3303	0.7624	0.8294	0.9383	0.9846	0.4509	0.9207	0.7909	0.9108	0.7493	0.9988	0.9647	0.3953	0.8379	0.6762	0.7896	0.6763	0.9971
0.0348	28.29	2320	0.3290	0.7726	0.8442	0.9384	0.9813	0.5497	0.9144	0.7723	0.9233	0.7689	0.9991	0.9648	0.4603	0.8368	0.6741	0.7889	0.6864	0.9968
0.0613	28.54	2340	0.3243	0.7716	0.8412	0.9390	0.9845	0.5196	0.9183	0.7645	0.9230	0.7797	0.9990	0.9648	0.4432	0.8364	0.6745	0.7894	0.6961	0.9970
0.0561	28.78	2360	0.3364	0.7712	0.8417	0.9384	0.9854	0.5267	0.9070	0.7671	0.9243	0.7833	0.9981	0.9648	0.4469	0.8355	0.6727	0.7872	0.6941	0.9972
0.051	29.02	2380	0.3470	0.7779	0.8563	0.9375	0.9825	0.6252	0.9132	0.7795	0.9038	0.7915	0.9986	0.9655	0.5035	0.8367	0.6669	0.7830	0.6923	0.9972
0.0249	29.27	2400	0.3659	0.7658	0.8363	0.9376	0.9860	0.4942	0.9175	0.7694	0.9121	0.7767	0.9985	0.9646	0.4209	0.8363	0.6672	0.7842	0.6901	0.9971
0.0322	29.51	2420	0.3596	0.7666	0.8374	0.9378	0.9819	0.4925	0.9202	0.7731	0.9110	0.7850	0.9984	0.9644	0.4217	0.8361	0.6686	0.7850	0.6932	0.9973
0.0473	29.76	2440	0.3501	0.7664	0.8363	0.9384	0.9861	0.4770	0.9151	0.7702	0.9121	0.7954	0.9981	0.9644	0.4089	0.8377	0.6714	0.7849	0.7002	0.9973
0.0373	30.0	2460	0.3375	0.7571	0.8235	0.9378	0.9867	0.4027	0.9193	0.7815	0.9091	0.7668	0.9981	0.9630	0.3564	0.8380	0.6714	0.7861	0.6875	0.9972
0.0415	30.24	2480	0.3230	0.7695	0.8391	0.9394	0.9865	0.4905	0.9062	0.7704	0.9173	0.8038	0.9992	0.9646	0.4169	0.8398	0.6773	0.7892	0.7018	0.9969
0.023	30.49	2500	0.3284	0.7734	0.8448	0.9403	0.9865	0.4943	0.9014	0.7698	0.9117	0.8511	0.9984	0.9647	0.4229	0.8395	0.6835	0.7889	0.7173	0.9973
0.0746	30.73	2520	0.3388	0.7713	0.8415	0.9398	0.9838	0.4801	0.9121	0.7629	0.9142	0.8387	0.9986	0.9644	0.4167	0.8402	0.6782	0.7883	0.7140	0.9973
0.0468	30.98	2540	0.3446	0.7756	0.8479	0.9389	0.9833	0.5564	0.9096	0.7794	0.9148	0.7935	0.9985	0.9656	0.4674	0.8403	0.6732	0.7888	0.6969	0.9973
0.0257	31.22	2560	0.3663	0.7678	0.8371	0.9380	0.9836	0.5014	0.9126	0.7739	0.9198	0.7705	0.9982	0.9653	0.4311	0.8394	0.6693	0.7859	0.6862	0.9973
0.1516	31.46	2580	0.3418	0.7661	0.8338	0.9392	0.9865	0.4536	0.9081	0.7723	0.9184	0.7998	0.9982	0.9648	0.3961	0.8399	0.6758	0.7888	0.7002	0.9973
0.1241	31.71	2600	0.3424	0.7699	0.8384	0.9392	0.9853	0.5002	0.9148	0.7822	0.9176	0.7698	0.9988	0.9655	0.4294	0.8400	0.6772	0.7908	0.6887	0.9973
0.0768	31.95	2620	0.3201	0.7747	0.8469	0.9396	0.9860	0.5485	0.9095	0.7722	0.9192	0.7940	0.9991	0.9659	0.4546	0.8402	0.6769	0.7908	0.6975	0.9971
0.0675	32.2	2640	0.3314	0.7741	0.8464	0.9388	0.9852	0.5593	0.9178	0.7701	0.9193	0.7744	0.9987	0.9656	0.4658	0.8366	0.6715	0.7904	0.6914	0.9972
0.0597	32.44	2660	0.3408	0.7713	0.8443	0.9380	0.9845	0.5475	0.9203	0.7840	0.9053	0.7698	0.9990	0.9659	0.4557	0.8393	0.6696	0.7871	0.6842	0.9971
0.0284	32.68	2680	0.3684	0.7701	0.8421	0.9382	0.9845	0.5241	0.9118	0.7772	0.9147	0.7849	0.9977	0.9651	0.4414	0.8362	0.6732	0.7872	0.6904	0.9971
0.1271	32.93	2700	0.3431	0.7724	0.8467	0.9383	0.9835	0.5404	0.9117	0.7855	0.8996	0.8079	0.9986	0.9658	0.4524	0.8362	0.6742	0.7846	0.6964	0.9975
0.0555	33.17	2720	0.3386	0.7752	0.8499	0.9386	0.9842	0.5763	0.8996	0.7841	0.9127	0.7935	0.9991	0.9656	0.4722	0.8328	0.6773	0.7881	0.6931	0.9973
0.0462	33.41	2740	0.3433	0.7714	0.8416	0.9392	0.9854	0.5143	0.9154	0.7865	0.9101	0.7807	0.9988	0.9658	0.4387	0.8367	0.6789	0.7898	0.6922	0.9975
0.0603	33.66	2760	0.3408	0.7767	0.8502	0.9390	0.9834	0.5767	0.9157	0.7825	0.9118	0.7823	0.9990	0.9661	0.4786	0.8374	0.6763	0.7891	0.6922	0.9974
0.0315	33.9	2780	0.3349	0.7717	0.8432	0.9386	0.9857	0.5284	0.9087	0.7813	0.9108	0.7890	0.9985	0.9655	0.4475	0.8373	0.6741	0.7875	0.6924	0.9973
0.1076	34.15	2800	0.3251	0.7679	0.8382	0.9387	0.9859	0.4756	0.9135	0.7862	0.8993	0.8085	0.9982	0.9653	0.4124	0.8401	0.6741	0.7854	0.7010	0.9973
0.0482	34.39	2820	0.3239	0.7676	0.8374	0.9388	0.9874	0.4803	0.9072	0.7828	0.9067	0.7987	0.9986	0.9653	0.4128	0.8395	0.6736	0.7868	0.6979	0.9976
0.1525	34.63	2840	0.3541	0.7625	0.8297	0.9383	0.9882	0.4431	0.9115	0.7750	0.9137	0.7779	0.9986	0.9640	0.3867	0.8389	0.6731	0.7854	0.6919	0.9973
0.0616	34.88	2860	0.3402	0.7664	0.8364	0.9377	0.9877	0.4787	0.9077	0.7727	0.9042	0.8050	0.9986	0.9640	0.4145	0.8395	0.6692	0.7799	0.7008	0.9972
0.0271	35.12	2880	0.3425	0.7775	0.8553	0.9376	0.9838	0.6081	0.9064	0.7798	0.8996	0.8104	0.9987	0.9660	0.4933	0.8408	0.6664	0.7792	0.6993	0.9974
0.1006	35.37	2900	0.3457	0.7764	0.8499	0.9388	0.9842	0.5641	0.9209	0.7709	0.9068	0.8030	0.9990	0.9656	0.4715	0.8439	0.6709	0.7837	0.7022	0.9972
0.0644	35.61	2920	0.3366	0.7728	0.8433	0.9395	0.9867	0.5212	0.9161	0.7713	0.9154	0.7938	0.9989	0.9655	0.4395	0.8438	0.6758	0.7876	0.7000	0.9973
0.1789	35.85	2940	0.3341	0.7747	0.8462	0.9396	0.9870	0.5396	0.9129	0.7713	0.9183	0.7964	0.9981	0.9658	0.4523	0.8430	0.6768	0.7882	0.6994	0.9974
0.0253	36.1	2960	0.3389	0.7769	0.8515	0.9386	0.9834	0.5893	0.9061	0.7757	0.9157	0.7912	0.9992	0.9661	0.4828	0.8401	0.6729	0.7860	0.6935	0.9972
0.0542	36.34	2980	0.3422	0.7758	0.8501	0.9382	0.9838	0.5750	0.9163	0.7807	0.9059	0.7904	0.9983	0.9661	0.4789	0.8418	0.6700	0.7841	0.6921	0.9975
0.0217	36.59	3000	0.3516	0.7750	0.8485	0.9381	0.9850	0.5718	0.9154	0.7808	0.9093	0.7792	0.9980	0.9661	0.4767	0.8420	0.6687	0.7850	0.6894	0.9973
0.0374	36.83	3020	0.3425	0.7814	0.8568	0.9395	0.9830	0.6156	0.9201	0.7733	0.9167	0.7906	0.9985	0.9667	0.5020	0.8429	0.6745	0.7883	0.6981	0.9976
0.0426	37.07	3040	0.3436	0.7764	0.8476	0.9399	0.9836	0.5385	0.9183	0.7688	0.9154	0.8098	0.9991	0.9660	0.4570	0.8428	0.6772	0.7891	0.7053	0.9973
0.0192	37.32	3060	0.3413	0.7791	0.8553	0.9388	0.9822	0.6076	0.9145	0.7757	0.9120	0.7964	0.9990	0.9662	0.4941	0.8409	0.6722	0.7871	0.6956	0.9975
0.0654	37.56	3080	0.3456	0.7780	0.8529	0.9392	0.9845	0.5859	0.9168	0.7745	0.9102	0.7994	0.9990	0.9664	0.4809	0.8411	0.6737	0.7873	0.6990	0.9975
0.0387	37.8	3100	0.3460	0.7758	0.8496	0.9389	0.9849	0.5651	0.9166	0.7760	0.9078	0.7979	0.9991	0.9661	0.4685	0.8413	0.6729	0.7866	0.6980	0.9973
0.0312	38.05	3120	0.3362	0.7752	0.8494	0.9384	0.9834	0.5731	0.9147	0.7806	0.9064	0.7881	0.9995	0.9654	0.4732	0.8406	0.6713	0.7864	0.6928	0.9968
0.023	38.29	3140	0.3474	0.7786	0.8549	0.9387	0.9826	0.6057	0.9138	0.7812	0.9092	0.7931	0.9989	0.9661	0.4926	0.8401	0.6728	0.7879	0.6938	0.9974
0.0204	38.54	3160	0.3287	0.7759	0.8489	0.9393	0.9849	0.5570	0.9121	0.7799	0.9096	0.7997	0.9990	0.9660	0.4643	0.8407	0.6753	0.7887	0.6991	0.9973
0.0676	38.78	3180	0.3485	0.7717	0.8417	0.9396	0.9868	0.5033	0.9104	0.7705	0.9171	0.8056	0.9986	0.9654	0.4285	0.8405	0.6769	0.7895	0.7040	0.9972
0.0312	39.02	3200	0.3597	0.7787	0.8529	0.9393	0.9830	0.5874	0.9159	0.7752	0.9152	0.7951	0.9987	0.9662	0.4840	0.8413	0.6747	0.7886	0.6988	0.9973
0.0392	39.27	3220	0.3508	0.7762	0.8490	0.9390	0.9843	0.5641	0.9162	0.7803	0.9107	0.7887	0.9987	0.9662	0.4712	0.8415	0.6732	0.7884	0.6958	0.9973
0.027	39.51	3240	0.3385	0.7775	0.8510	0.9399	0.9853	0.5561	0.9128	0.7709	0.9115	0.8212	0.9990	0.9659	0.4629	0.8420	0.6781	0.7893	0.7074	0.9971
0.0287	39.76	3260	0.3301	0.7703	0.8404	0.9392	0.9867	0.4985	0.9117	0.7794	0.9087	0.7985	0.9989	0.9653	0.4252	0.8413	0.6749	0.7884	0.6995	0.9971
0.0608	40.0	3280	0.3485	0.7745	0.8460	0.9397	0.9854	0.5267	0.9100	0.7714	0.9143	0.8156	0.9987	0.9657	0.4461	0.8412	0.6769	0.7892	0.7052	0.9973

Framework versions

• Transformers 4.35.0
• Pytorch 2.0.0
• Datasets 2.1.0
• Tokenizers 0.14.1