wav2vec2-xls-r-wolof-kallaama-fleurs-51-hours

This model is a fine-tuned version of facebook/wav2vec2-xls-r-300m on the fleurs dataset. It achieves the following results on the evaluation set:

• Loss: 1.8616
• Wer: 0.4399
• Cer: 0.1546

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 0.0003
• train_batch_size: 4
• eval_batch_size: 4
• seed: 42
• gradient_accumulation_steps: 4
• total_train_batch_size: 16
• optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: linear
• lr_scheduler_warmup_steps: 500
• num_epochs: 50

Training results

Training Loss	Epoch	Step	Validation Loss	Wer	Cer
24.5493	0.1575	200	3.7703	1.0	1.0
12.2505	0.3150	400	3.3110	1.0	1.0
11.1429	0.4725	600	1.7062	0.9763	0.5303
7.4292	0.6300	800	1.1555	0.8203	0.3068
6.1758	0.7876	1000	1.1934	0.7889	0.3195
5.7405	0.9451	1200	0.9764	0.6756	0.2434
5.2478	1.1028	1400	0.8358	0.6013	0.2174
4.9915	1.2603	1600	0.8527	0.5875	0.2117
4.851	1.4178	1800	0.7899	0.5813	0.2077
4.7906	1.5753	2000	0.7579	0.5671	0.2017
4.6304	1.7328	2200	0.7618	0.5517	0.2000
4.5587	1.8903	2400	0.7451	0.5443	0.1897
4.3086	2.0480	2600	0.7567	0.5340	0.1890
4.0759	2.2056	2800	0.7002	0.5332	0.1907
3.9794	2.3631	3000	0.7629	0.5324	0.1896
4.047	2.5206	3200	0.7807	0.5452	0.1902
4.0203	2.6781	3400	0.7639	0.5231	0.1869
3.9924	2.8356	3600	0.6793	0.4938	0.1800
3.8478	2.9931	3800	0.6835	0.5089	0.1858
3.5849	3.1508	4000	0.7441	0.5403	0.1885
3.6008	3.3083	4200	0.7008	0.5075	0.1815
3.6122	3.4658	4400	0.7253	0.5303	0.1877
3.6241	3.6234	4600	0.7265	0.5235	0.1907
3.6413	3.7809	4800	0.7743	0.5301	0.1849
3.5272	3.9384	5000	0.6916	0.5031	0.1797
3.4504	4.0961	5200	0.6639	0.4909	0.1732
3.2667	4.2536	5400	0.7118	0.4871	0.1757
3.2712	4.4111	5600	0.6767	0.4837	0.1717
3.406	4.5686	5800	0.6909	0.4739	0.1692
3.2874	4.7261	6000	0.6811	0.4871	0.1735
3.3033	4.8836	6200	0.6808	0.4929	0.1753
3.2683	5.0413	6400	0.6942	0.4778	0.1715
2.9944	5.1989	6600	0.6875	0.4894	0.1744
3.0383	5.3564	6800	0.6741	0.4726	0.1683
3.083	5.5139	7000	0.7064	0.4985	0.1756
3.1615	5.6714	7200	0.7036	0.4736	0.1706
3.12	5.8289	7400	0.6677	0.4978	0.1754
3.1098	5.9864	7600	0.6835	0.4878	0.1776
2.8524	6.1441	7800	0.6837	0.4941	0.1717
2.8578	6.3016	8000	0.6782	0.4749	0.1672
2.8484	6.4591	8200	0.7119	0.5041	0.1730
2.8739	6.6167	8400	0.6971	0.5116	0.1749
3.0153	6.7742	8600	0.7270	0.4990	0.1751
2.9535	6.9317	8800	0.7064	0.4916	0.1729
2.8795	7.0894	9000	0.6751	0.4680	0.1677
2.7497	7.2469	9200	0.6918	0.4723	0.1694
2.7365	7.4044	9400	0.6830	0.4639	0.1647
2.7534	7.5619	9600	0.6763	0.4604	0.1644
2.8187	7.7194	9800	0.6652	0.4646	0.1671
2.8491	7.8769	10000	0.6736	0.4660	0.1658
2.6734	8.0347	10200	0.7089	0.4883	0.1718
2.5782	8.1922	10400	0.7383	0.4884	0.1761
2.6723	8.3497	10600	0.7013	0.4840	0.1666
2.616	8.5072	10800	0.6994	0.4807	0.1709
2.6426	8.6647	11000	0.7167	0.4805	0.1724
2.6932	8.8222	11200	0.6707	0.4823	0.1720
2.6286	8.9797	11400	0.7270	0.4936	0.1739
2.4839	9.1374	11600	0.7647	0.4862	0.1731
2.4743	9.2949	11800	0.7901	0.4839	0.1728
2.4371	9.4525	12000	0.7760	0.4746	0.1696
2.5398	9.6100	12200	0.7639	0.4800	0.1699
2.5612	9.7675	12400	0.7299	0.4647	0.1631
2.5284	9.9250	12600	0.7125	0.4715	0.1676
2.5188	10.0827	12800	0.7131	0.4747	0.1708
2.3939	10.2402	13000	0.6930	0.4638	0.1644
2.3693	10.3977	13200	0.7400	0.4756	0.1685
2.3735	10.5552	13400	0.7157	0.4648	0.1656
2.3927	10.7127	13600	0.7309	0.4759	0.1710
2.3976	10.8703	13800	0.6777	0.4768	0.1719
2.3047	11.0280	14000	0.7849	0.4699	0.1692
2.2681	11.1855	14200	0.7695	0.4782	0.1708
2.2397	11.3430	14400	0.7707	0.4685	0.1679
2.3195	11.5005	14600	0.8306	0.4749	0.1715
2.3249	11.6580	14800	0.7988	0.4786	0.1713
2.3513	11.8155	15000	0.7898	0.4685	0.1667
2.374	11.9730	15200	0.8080	0.4607	0.1657
2.2239	12.1307	15400	0.7137	0.4569	0.1633
2.2403	12.2882	15600	0.7270	0.4534	0.1606
2.1914	12.4458	15800	0.7244	0.4622	0.1654
2.2147	12.6033	16000	0.7736	0.4578	0.1634
2.1914	12.7608	16200	0.8050	0.4645	0.1670
2.196	12.9183	16400	0.7433	0.4554	0.1629
2.1812	13.0760	16600	0.8202	0.4744	0.1680
2.1696	13.2335	16800	0.8359	0.4635	0.1669
2.0787	13.3910	17000	0.8509	0.4785	0.1695
2.1515	13.5485	17200	0.8423	0.4779	0.1689
2.117	13.7060	17400	0.8142	0.4649	0.1659
2.183	13.8636	17600	0.7949	0.4686	0.1660
2.1078	14.0213	17800	0.8212	0.4669	0.1630
2.0658	14.1788	18000	0.8367	0.4629	0.1633
2.0649	14.3363	18200	0.8542	0.4661	0.1627
2.0219	14.4938	18400	0.8237	0.4652	0.1650
2.1089	14.6513	18600	0.8589	0.4634	0.1658
2.0612	14.8088	18800	0.7892	0.4554	0.1630
1.99	14.9663	19000	0.8774	0.4572	0.1614
1.9219	15.1240	19200	0.8620	0.4654	0.1660
1.8854	15.2816	19400	0.8427	0.4724	0.1679
1.9855	15.4391	19600	0.8677	0.4781	0.1684
2.0109	15.5966	19800	0.8339	0.4569	0.1613
2.0556	15.7541	20000	0.7858	0.4661	0.1653
1.9582	15.9116	20200	0.8343	0.4629	0.1654
1.8696	16.0693	20400	0.9335	0.4664	0.1668
1.8848	16.2268	20600	0.9433	0.4713	0.1671
1.883	16.3843	20800	0.8845	0.4465	0.1629
1.8853	16.5418	21000	0.9152	0.4711	0.1683
1.8708	16.6994	21200	0.9011	0.4778	0.1688
1.8629	16.8569	21400	0.9455	0.4608	0.1633
1.9271	17.0146	21600	0.8604	0.4640	0.1645
1.7885	17.1721	21800	0.8746	0.4569	0.1622
1.7901	17.3296	22000	0.9047	0.4674	0.1665
1.8563	17.4871	22200	0.8701	0.4499	0.1615
1.8878	17.6446	22400	0.8832	0.4604	0.1653
1.8532	17.8021	22600	0.8801	0.4538	0.1622
1.7788	17.9596	22800	0.8914	0.4639	0.1664
1.8292	18.1173	23000	0.9818	0.4677	0.1694
1.6927	18.2749	23200	0.9756	0.4687	0.1683
1.7299	18.4324	23400	0.9824	0.4875	0.1728
1.7984	18.5899	23600	1.0267	0.4786	0.1697
1.7623	18.7474	23800	1.0158	0.4657	0.1665
1.7752	18.9049	24000	0.9718	0.4735	0.1707
1.6872	19.0626	24200	1.0216	0.4599	0.1629
1.6729	19.2201	24400	0.9651	0.4525	0.1620
1.6822	19.3776	24600	1.0366	0.4657	0.1698
1.7131	19.5351	24800	1.0244	0.4862	0.1726
1.7334	19.6927	25000	1.0151	0.4642	0.1656
1.6964	19.8502	25200	1.0163	0.4568	0.1624
1.7588	20.0079	25400	1.0276	0.4527	0.1627
1.638	20.1654	25600	0.9684	0.4489	0.1623
1.6229	20.3229	25800	1.0034	0.4699	0.1664
1.7059	20.4804	26000	0.9936	0.4551	0.1599
1.6466	20.6379	26200	0.9931	0.4669	0.1658
1.5954	20.7954	26400	0.9628	0.4671	0.1670
1.5909	20.9529	26600	1.0000	0.4634	0.1650
1.4955	21.1107	26800	1.0323	0.4612	0.1634
1.5799	21.2682	27000	1.0642	0.4589	0.1650
1.6474	21.4257	27200	1.1078	0.4798	0.1681
1.5695	21.5832	27400	1.1049	0.4664	0.1648
1.585	21.7407	27600	1.0424	0.4624	0.1628
1.554	21.8982	27800	1.1015	0.4747	0.1663
1.5468	22.0559	28000	1.0979	0.4526	0.1604
1.4665	22.2134	28200	1.0616	0.4693	0.1637
1.4982	22.3709	28400	0.9932	0.4533	0.1621
1.4755	22.5285	28600	1.0805	0.4556	0.1626
1.56	22.6860	28800	1.1048	0.4607	0.1636
1.5541	22.8435	29000	1.1063	0.4586	0.1618
1.5757	23.0012	29200	1.0304	0.4596	0.1621
1.4134	23.1587	29400	1.2138	0.4630	0.1611
1.5295	23.3162	29600	1.1297	0.4594	0.1629
1.4101	23.4737	29800	1.1846	0.4569	0.1631
1.3852	23.6312	30000	1.1506	0.4528	0.1609
1.4878	23.7887	30200	1.1126	0.4614	0.1640
1.4796	23.9462	30400	1.1073	0.4571	0.1625
1.3456	24.1040	30600	1.1784	0.4606	0.1621
1.3714	24.2615	30800	1.1570	0.4555	0.1625
1.4094	24.4190	31000	1.2130	0.4619	0.1640
1.4385	24.5765	31200	1.1882	0.4659	0.1643
1.3741	24.7340	31400	1.1343	0.4629	0.1665
1.4203	24.8915	31600	1.1909	0.4602	0.1637
1.4185	25.0492	31800	1.1586	0.4654	0.1648
1.3305	25.2067	32000	1.1612	0.4561	0.1616
1.3085	25.3642	32200	1.2283	0.4570	0.1639
1.3189	25.5218	32400	1.1803	0.4623	0.1647
1.3947	25.6793	32600	1.1863	0.4567	0.1619
1.3461	25.8368	32800	1.1685	0.4691	0.1658
1.3613	25.9943	33000	1.1223	0.4590	0.1635
1.2692	26.1520	33200	1.2214	0.4657	0.1631
1.2652	26.3095	33400	1.2440	0.4599	0.1609
1.2693	26.4670	33600	1.2214	0.4620	0.1644
1.2916	26.6245	33800	1.2799	0.4527	0.1622
1.3155	26.7820	34000	1.2418	0.4598	0.1618
1.3121	26.9396	34200	1.2349	0.4585	0.1627
1.2446	27.0973	34400	1.1949	0.4630	0.1650
1.1781	27.2548	34600	1.2707	0.4628	0.1632
1.2162	27.4123	34800	1.2774	0.4594	0.1615
1.2225	27.5698	35000	1.2332	0.4591	0.1621
1.2676	27.7273	35200	1.2531	0.4492	0.1596
1.2711	27.8848	35400	1.2514	0.4502	0.1581
1.2549	28.0425	35600	1.3105	0.4581	0.1636
1.1431	28.2000	35800	1.3143	0.4551	0.1599
1.124	28.3576	36000	1.3114	0.4521	0.1603
1.2212	28.5151	36200	1.3250	0.4573	0.1620
1.2088	28.6726	36400	1.3342	0.4583	0.1591
1.1607	28.8301	36600	1.2654	0.4608	0.1627
1.1659	28.9876	36800	1.3213	0.4520	0.1603
1.066	29.1453	37000	1.3631	0.4475	0.1575
1.1354	29.3028	37200	1.3623	0.4565	0.1608
1.0732	29.4603	37400	1.3907	0.4492	0.1590
1.1163	29.6178	37600	1.3514	0.4529	0.1607
1.1716	29.7753	37800	1.3971	0.4562	0.1596
1.1248	29.9329	38000	1.3384	0.4508	0.1596
1.105	30.0906	38200	1.3285	0.4500	0.1588
1.066	30.2481	38400	1.3858	0.4590	0.1617
1.0743	30.4056	38600	1.3475	0.4529	0.1588
1.0792	30.5631	38800	1.4045	0.4582	0.1618
1.0545	30.7206	39000	1.3784	0.4500	0.1609
1.0809	30.8781	39200	1.3293	0.4516	0.1598
1.0478	31.0358	39400	1.4849	0.4495	0.1597
1.0195	31.1933	39600	1.4046	0.4533	0.1600
1.0138	31.3509	39800	1.4021	0.4496	0.1602
1.0158	31.5084	40000	1.4626	0.4631	0.1636
1.0249	31.6659	40200	1.4203	0.4556	0.1613
1.0242	31.8234	40400	1.4382	0.4491	0.1593
1.0402	31.9809	40600	1.4819	0.4590	0.1617
0.9521	32.1386	40800	1.4232	0.4529	0.1597
0.9398	32.2961	41000	1.4590	0.4466	0.1596
0.9543	32.4536	41200	1.4332	0.4515	0.1588
1.0095	32.6111	41400	1.4284	0.4565	0.1614
0.9868	32.7687	41600	1.4011	0.4546	0.1598
1.008	32.9262	41800	1.4713	0.4484	0.1596
0.9902	33.0839	42000	1.4960	0.4511	0.1607
0.9172	33.2414	42200	1.4854	0.4577	0.1613
0.8963	33.3989	42400	1.4862	0.4521	0.1595
0.9316	33.5564	42600	1.4859	0.4447	0.1579
0.9189	33.7139	42800	1.4577	0.4511	0.1591
0.9631	33.8714	43000	1.4772	0.4500	0.1586
0.9047	34.0291	43200	1.5225	0.4453	0.1571
0.8641	34.1867	43400	1.5279	0.4479	0.1588
0.8997	34.3442	43600	1.4808	0.4457	0.1574
0.8629	34.5017	43800	1.4708	0.4463	0.1575
0.8572	34.6592	44000	1.4984	0.4449	0.1569
0.9006	34.8167	44200	1.5450	0.4543	0.1595
0.9065	34.9742	44400	1.5011	0.4465	0.1576
0.8554	35.1319	44600	1.5023	0.4463	0.1565
0.8436	35.2894	44800	1.5042	0.4501	0.1577
0.8305	35.4469	45000	1.4979	0.4486	0.1579
0.8674	35.6044	45200	1.5442	0.4470	0.1575
0.8462	35.7620	45400	1.5034	0.4482	0.1568
0.8417	35.9195	45600	1.5295	0.4447	0.1578
0.8107	36.0772	45800	1.4983	0.4399	0.1558
0.778	36.2347	46000	1.5675	0.4572	0.1594
0.8107	36.3922	46200	1.5692	0.4412	0.1557
0.8338	36.5497	46400	1.6011	0.4482	0.1580
0.7727	36.7072	46600	1.5607	0.4423	0.1558
0.8205	36.8647	46800	1.5401	0.4479	0.1581
0.7926	37.0224	47000	1.5958	0.4457	0.1574
0.7824	37.1800	47200	1.6331	0.4449	0.1569
0.7667	37.3375	47400	1.5664	0.4371	0.1547
0.7419	37.4950	47600	1.5837	0.4466	0.1570
0.7683	37.6525	47800	1.5553	0.4500	0.1577
0.7798	37.8100	48000	1.5464	0.4465	0.1567
0.7504	37.9675	48200	1.5609	0.4467	0.1578
0.7889	38.1252	48400	1.5964	0.4498	0.1582
0.733	38.2827	48600	1.6166	0.4507	0.1587
0.7379	38.4402	48800	1.5647	0.4485	0.1567
0.7221	38.5978	49000	1.5836	0.4518	0.1576
0.7392	38.7553	49200	1.6365	0.4446	0.1573
0.7311	38.9128	49400	1.5920	0.4491	0.1573
0.7206	39.0705	49600	1.6210	0.4369	0.1549
0.7205	39.2280	49800	1.6992	0.4439	0.1557
0.7046	39.3855	50000	1.6462	0.4457	0.1575
0.6976	39.5430	50200	1.6442	0.4472	0.1574
0.6821	39.7005	50400	1.6606	0.4431	0.1558
0.7126	39.8580	50600	1.6507	0.4496	0.1586
0.6929	40.0158	50800	1.6567	0.4534	0.1591
0.7218	40.1733	51000	1.6601	0.4494	0.1577
0.6622	40.3308	51200	1.6273	0.4457	0.1568
0.6644	40.4883	51400	1.6165	0.4441	0.1568
0.7289	40.6458	51600	1.6866	0.4474	0.1576
0.6763	40.8033	51800	1.7026	0.4444	0.1571
0.6498	40.9608	52000	1.6400	0.4385	0.1547
0.674	41.1185	52200	1.6579	0.4398	0.1557
0.6564	41.2760	52400	1.6870	0.4456	0.1570
0.6372	41.4335	52600	1.7145	0.4492	0.1575
0.6763	41.5911	52800	1.6573	0.4413	0.1569
0.6612	41.7486	53000	1.7089	0.4389	0.1569
0.6768	41.9061	53200	1.7296	0.4435	0.1571
0.6082	42.0638	53400	1.7401	0.4411	0.1559
0.6064	42.2213	53600	1.7245	0.4426	0.1564
0.649	42.3788	53800	1.7227	0.4387	0.1555
0.6309	42.5363	54000	1.7621	0.4450	0.1564
0.5927	42.6938	54200	1.7180	0.4465	0.1571
0.6205	42.8513	54400	1.7383	0.4415	0.1557
0.625	43.0091	54600	1.7127	0.4450	0.1563
0.6199	43.1666	54800	1.7375	0.4478	0.1566
0.6123	43.3241	55000	1.7563	0.4456	0.1556
0.6015	43.4816	55200	1.7443	0.4415	0.1542
0.6324	43.6391	55400	1.7117	0.4398	0.1542
0.5914	43.7966	55600	1.7323	0.4408	0.1546
0.5998	43.9541	55800	1.7082	0.4394	0.1545
0.5528	44.1118	56000	1.7526	0.4451	0.1557
0.6034	44.2693	56200	1.7625	0.4435	0.1551
0.5834	44.4269	56400	1.7680	0.4447	0.1552
0.5892	44.5844	56600	1.7437	0.4414	0.1548
0.5835	44.7419	56800	1.7650	0.4420	0.1547
0.6083	44.8994	57000	1.7806	0.4452	0.1556
0.5759	45.0571	57200	1.7970	0.4411	0.1547
0.586	45.2146	57400	1.7931	0.4404	0.1543
0.5613	45.3721	57600	1.8048	0.4408	0.1542
0.5655	45.5296	57800	1.7696	0.4323	0.1532
0.5782	45.6871	58000	1.8078	0.4369	0.1541
0.5522	45.8447	58200	1.7927	0.4349	0.1528
0.5691	46.0024	58400	1.7770	0.4387	0.1536
0.5627	46.1599	58600	1.7870	0.4354	0.1529
0.5408	46.3174	58800	1.8022	0.4359	0.1532
0.5499	46.4749	59000	1.7963	0.4391	0.1540
0.5447	46.6324	59200	1.8098	0.4390	0.1532
0.5509	46.7899	59400	1.8363	0.4386	0.1536
0.5736	46.9474	59600	1.8304	0.4407	0.1545
0.5109	47.1051	59800	1.8288	0.4386	0.1536
0.5269	47.2627	60000	1.8539	0.4387	0.1538
0.5596	47.4202	60200	1.8186	0.4391	0.1540
0.5421	47.5777	60400	1.7925	0.4387	0.1539
0.521	47.7352	60600	1.8174	0.4411	0.1544
0.5303	47.8927	60800	1.8274	0.4396	0.1546
0.5488	48.0504	61000	1.8253	0.4403	0.1548
0.5243	48.2079	61200	1.8425	0.4412	0.1546
0.5213	48.3654	61400	1.8394	0.4414	0.1549
0.5363	48.5229	61600	1.8324	0.4401	0.1547
0.5192	48.6804	61800	1.8467	0.4399	0.1543
0.5188	48.8380	62000	1.8362	0.4404	0.1548
0.5421	48.9955	62200	1.8380	0.4433	0.1553
0.5293	49.1532	62400	1.8531	0.4412	0.1548
0.4924	49.3107	62600	1.8582	0.4397	0.1546
0.5473	49.4682	62800	1.8579	0.4407	0.1547
0.4958	49.6257	63000	1.8636	0.4399	0.1545
0.5439	49.7832	63200	1.8625	0.4403	0.1548
0.5181	49.9407	63400	1.8616	0.4399	0.1546

Framework versions

• Transformers 4.46.1
• Pytorch 2.1.0+cu118
• Datasets 2.17.0
• Tokenizers 0.20.3