PreTrain Wav2Vec2 in Swedish
PreTrain Wav2Vec2 in SwedishThere is currently only a multilingually pretrained model for Swedish Wav2Vec2. Let’s make a Wav2Vec2 only pretrained on Swedish.ModelA randomly initialized Wav2Vec2 modelDatasetsOne can make useCommon Voicethe dataset is also available through thedatasetslibrary here:common_voice · Datasets at Hugging Face.Available training scriptsFlaxWav2Vec2 will be merged soon:[Flax] Add wav2vec2 by patrickvonplaten · Pull Request #12271 · huggingface/transformers · GitHuband a pretraining script should be relatively easy to be merged.(Optional) Desired project outcomeThe best Swedish ASR model.(Optional) ChallengesIt might make sense to use more data than just common voice.
2021-06-29T08:03:35Z
Maybe also interesting for@marma?
2021-06-29T10:20:17Z
It would be interesting, the problem for us is that we cannot share data. However, we have been pretraining a large Wav2Vec2 at the KB for some time and right now, in the middle of training, it (marginally) outperforms the Swedish VoxPopuli. I’ll write something up and publish it before I go on vacation in two-three days. At least the license will be better than CC NonCommercial.Screenshot 2021-06-15 at 16.01.481050×462 20 KB
2021-06-29T10:23:25Z
“It” being the model in this case. We’ll detail it in a pre-print at some point.