wav2vec2-epochss30

This model is a fine-tuned version of facebook/wav2vec2-xls-r-1b on the None dataset. It achieves the following results on the evaluation set:

• Loss: 691.4627
• Wer: 0.4459
• Cer: 0.1989

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 0.0001
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• gradient_accumulation_steps: 2
• total_train_batch_size: 16
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• lr_scheduler_warmup_ratio: 0.1
• num_epochs: 30
• mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss	Wer	Cer
1999.435	0.17	200	1887.2690	1.0	1.0
1841.6292	0.34	400	1783.8219	1.0	1.0
1181.557	0.52	600	899.7112	0.9309	0.3423
956.7506	0.69	800	735.2280	0.7547	0.2706
794.5134	0.86	1000	680.8569	0.6805	0.2465
835.6966	1.03	1200	603.0405	0.6308	0.2352
680.8182	1.21	1400	581.7413	0.5960	0.2193
673.1087	1.38	1600	528.3048	0.5798	0.2095
613.3601	1.55	1800	522.6011	0.5819	0.2146
634.4782	1.72	2000	520.1198	0.5391	0.2008
610.8104	1.89	2200	498.6251	0.5394	0.2001
633.1336	2.07	2400	511.0258	0.5464	0.2022
589.8632	2.24	2600	498.8234	0.5605	0.2078
617.5509	2.41	2800	474.8568	0.5090	0.1938
571.7622	2.58	3000	480.4093	0.5252	0.1993
539.1432	2.76	3200	504.1433	0.5323	0.1983
528.1947	2.93	3400	466.5134	0.5067	0.1921
578.2223	3.1	3600	488.9817	0.4971	0.1898
559.4901	3.27	3800	497.9755	0.5046	0.1930
562.7119	3.44	4000	503.1867	0.5150	0.1985
519.3087	3.62	4200	593.1354	0.5472	0.2073
556.8025	3.79	4400	495.8975	0.4984	0.1886
567.8514	3.96	4600	541.9875	0.5169	0.1944
477.1474	4.13	4800	481.6547	0.4853	0.1866
517.4528	4.3	5000	474.3923	0.4837	0.1873
539.4832	4.48	5200	476.7122	0.4838	0.1862
461.7369	4.65	5400	474.8855	0.4863	0.1884
494.753	4.82	5600	459.4039	0.4772	0.1851
456.3248	4.99	5800	458.8958	0.4805	0.1856
508.5068	5.17	6000	446.5332	0.4880	0.1874
506.8071	5.34	6200	472.0066	0.4667	0.1823
512.5874	5.51	6400	451.6526	0.4916	0.1871
469.0896	5.68	6600	531.2655	0.4990	0.1921
497.2131	5.85	6800	463.2614	0.4642	0.1790
454.9095	6.03	7000	469.2678	0.4638	0.1804
468.6043	6.2	7200	480.2740	0.4702	0.1815
491.5936	6.37	7400	435.2616	0.4672	0.1783
440.4198	6.54	7600	467.7566	0.4448	0.1769
440.0505	6.72	7800	454.7561	0.4545	0.1783
451.3083	6.89	8000	487.3111	0.4694	0.1876
453.8571	7.06	8200	493.2177	0.4463	0.1746
431.2755	7.23	8400	461.0711	0.4350	0.1729
438.905	7.4	8600	454.5393	0.4330	0.1751
431.4689	7.58	8800	526.4275	0.5114	0.2036
437.3339	7.75	9000	450.4821	0.4403	0.1768
400.7543	7.92	9200	462.1681	0.4347	0.1733
447.5095	8.09	9400	538.9529	0.4928	0.1895
443.7493	8.27	9600	484.8204	0.4428	0.1755
419.3364	8.44	9800	465.8477	0.4434	0.1761
408.4448	8.61	10000	451.9768	0.4343	0.1724
422.0452	8.78	10200	491.6036	0.4307	0.1708
399.0995	8.95	10400	501.0275	0.4377	0.1751
376.666	9.13	10600	493.4771	0.4499	0.1802
398.0839	9.3	10800	551.9608	0.4513	0.1790
405.5591	9.47	11000	498.3957	0.4265	0.1711
428.8842	9.64	11200	508.3471	0.4373	0.1726
384.0768	9.81	11400	552.3915	0.4533	0.1806
426.3599	9.99	11600	483.7910	0.4403	0.1767
351.013	10.16	11800	524.2458	0.4349	0.1733
359.3337	10.33	12000	481.4625	0.4220	0.1691
416.8707	10.5	12200	471.1905	0.4179	0.1678
365.5677	10.68	12400	511.1335	0.4244	0.1708
406.9762	10.85	12600	480.2353	0.4143	0.1674
382.6786	11.02	12800	446.3556	0.4117	0.1668
362.7441	11.19	13000	466.6096	0.4250	0.1693
386.3758	11.36	13200	513.5801	0.4262	0.1732
340.6753	11.54	13400	522.4371	0.4397	0.1756
436.3263	11.71	13600	493.2019	0.4357	0.1749
383.312	11.88	13800	450.5116	0.4302	0.1711
372.5614	12.05	14000	503.3403	0.4392	0.1764
363.8336	12.23	14200	501.8123	0.4448	0.1787
371.7885	12.4	14400	451.1018	0.4094	0.1681
366.5141	12.57	14600	489.3454	0.4270	0.1726
341.6298	12.74	14800	526.7245	0.4368	0.1753
369.5208	12.91	15000	476.7443	0.4131	0.1705
287.0876	13.09	15200	532.9935	0.4278	0.1732
352.1687	13.26	15400	474.7348	0.4163	0.1696
351.7196	13.43	15600	518.1749	0.4141	0.1688
400.3397	13.6	15800	494.3698	0.4150	0.1705
342.1233	13.78	16000	519.3989	0.4174	0.1680
363.4793	13.95	16200	562.0712	0.4482	0.1799
306.6308	14.12	16400	497.2650	0.4236	0.1699
364.7656	14.29	16600	522.6184	0.4266	0.1731
303.2384	14.46	16800	509.9944	0.4450	0.1820
340.4591	14.64	17000	561.6015	0.4510	0.1847
332.268	14.81	17200	487.5699	0.4029	0.1662
299.443	14.98	17400	483.2515	0.4027	0.1655
316.1047	15.15	17600	533.9055	0.4315	0.1787
334.8094	15.33	17800	526.1489	0.4206	0.1724
330.0454	15.5	18000	486.5660	0.3972	0.1638
320.5774	15.67	18200	471.8959	0.3973	0.1645
339.05	15.84	18400	511.7763	0.4040	0.1670
326.6598	16.01	18600	489.6154	0.3970	0.1645
305.4735	16.19	18800	487.8466	0.4047	0.1679
337.9368	16.36	19000	476.1209	0.3982	0.1669
299.9719	16.53	19200	504.1047	0.4086	0.1692
317.0224	16.7	19400	504.1722	0.4126	0.1707
257.2306	16.87	19600	487.7587	0.4013	0.1672
294.6071	17.05	19800	509.7581	0.3993	0.1670
269.9198	17.22	20000	509.4766	0.3949	0.1656
319.7564	17.39	20200	510.5703	0.3946	0.1660
314.8401	17.56	20400	497.6968	0.4068	0.1687
299.1959	17.74	20600	504.6100	0.3891	0.1652
292.718	17.91	20800	511.6265	0.4048	0.1689
261.7871	18.08	21000	505.8485	0.4134	0.1708
283.0642	18.25	21200	540.3729	0.4118	0.1706
272.6834	18.42	21400	526.1393	0.4069	0.1704
274.3518	18.6	21600	504.8171	0.3951	0.1678
277.9652	18.77	21800	509.2921	0.4004	0.1688
309.1659	18.94	22000	526.6141	0.4245	0.1770
314.9563	19.11	22200	528.7372	0.4169	0.1753
246.9194	19.29	22400	546.9174	0.4067	0.1704
291.1215	19.46	22600	546.1392	0.4247	0.1772
247.5065	19.63	22800	540.7504	0.4154	0.1750
253.9247	19.8	23000	528.6477	0.4198	0.1764
256.4825	19.97	23200	515.7706	0.4081	0.1723
244.1212	20.15	23400	529.6173	0.4222	0.1769
239.6759	20.32	23600	551.2872	0.4547	0.1895
238.7839	20.49	23800	524.0603	0.4147	0.1767
222.0462	20.66	24000	539.2148	0.4232	0.1778
255.8469	20.84	24200	537.3892	0.3866	0.1654
297.8371	21.01	24400	530.9818	0.3896	0.1673
271.7028	21.18	24600	552.5524	0.4232	0.1815
267.7798	21.35	24800	546.0207	0.4282	0.1818
245.1966	21.52	25000	551.8063	0.4403	0.1847
267.1597	21.7	25200	553.4925	0.4192	0.1769
240.1538	21.87	25400	580.3679	0.4356	0.1866
243.4473	22.04	25600	582.0609	0.4362	0.1854
242.6595	22.21	25800	575.9413	0.4366	0.1861
229.599	22.38	26000	575.5670	0.4390	0.1860
240.6279	22.56	26200	567.9373	0.4292	0.1829
225.8621	22.73	26400	580.7449	0.4298	0.1817
240.5293	22.9	26600	576.1844	0.4156	0.1801
198.0407	23.07	26800	600.5076	0.4400	0.1919
210.6207	23.25	27000	627.8899	0.4653	0.2023
199.7722	23.42	27200	624.0092	0.4934	0.2131
232.1331	23.59	27400	599.5494	0.4571	0.1965
238.3379	23.76	27600	603.6340	0.4355	0.1880
225.5859	23.93	27800	607.5941	0.4561	0.1959
247.8019	24.11	28000	596.2225	0.4443	0.1922
216.5617	24.28	28200	607.2970	0.4569	0.1985
218.7046	24.45	28400	592.1700	0.4392	0.1912
222.9088	24.62	28600	620.0985	0.4518	0.1987
209.6746	24.8	28800	616.2948	0.4579	0.2008
214.2187	24.97	29000	602.7968	0.4318	0.1893
156.8316	25.14	29200	633.7986	0.4423	0.1968
178.302	25.31	29400	639.3934	0.4488	0.2015
198.2878	25.48	29600	634.5198	0.4319	0.1924
198.3269	25.66	29800	640.6528	0.4405	0.1939
191.4926	25.83	30000	640.3851	0.4498	0.1976
155.8671	26.0	30200	644.5180	0.4551	0.2014
197.995	26.17	30400	658.1439	0.4544	0.2027
197.5549	26.35	30600	651.4781	0.4282	0.1894
170.4004	26.52	30800	655.8338	0.4261	0.1895
170.3383	26.69	31000	651.6382	0.4331	0.1926
166.3114	26.86	31200	660.1794	0.4400	0.1941
203.6716	27.03	31400	680.4767	0.4543	0.2003
178.3413	27.21	31600	666.3619	0.4443	0.1976
169.2926	27.38	31800	672.3483	0.4529	0.2010
170.1905	27.55	32000	670.5322	0.4398	0.1952
199.6119	27.72	32200	674.4072	0.4447	0.1991
165.7702	27.89	32400	661.5322	0.4338	0.1921
175.2219	28.07	32600	675.0598	0.4397	0.1969
180.4852	28.24	32800	678.8405	0.4393	0.1972
174.4563	28.41	33000	681.9186	0.4413	0.1982
203.7395	28.58	33200	678.3680	0.4467	0.1987
172.7787	28.76	33400	690.3019	0.4563	0.2036
180.7431	28.93	33600	682.4417	0.4481	0.2006
152.5085	29.1	33800	691.6509	0.4522	0.2021
140.9367	29.27	34000	696.8735	0.4494	0.2001
154.269	29.44	34200	688.9243	0.4432	0.1972
159.18	29.62	34400	689.5714	0.4427	0.1976
178.9174	29.79	34600	690.8203	0.4479	0.1999
158.3995	29.96	34800	691.4627	0.4459	0.1989

Framework versions

• Transformers 4.38.2
• Pytorch 2.2.0+cu118
• Datasets 2.16.0
• Tokenizers 0.15.2