PreTrain Wav2Vec2 in Spanish
PreTrain Wav2Vec2 in SpanishThere is currently only a multilingually pretrained model for Spanish Wav2Vec2. Let’s make a Wav2Vec2 only pretrained on Spanish.ModelA randomly initialized Wav2Vec2 model.DatasetsWe can use the Spanish portion ofCommon Voice. The dataset is available through thedatasetslibrary here:common_voice · Datasets at Hugging Face.Available training scriptsFlaxWav2Vec2 will be merged soon:[Flax] Add wav2vec2 by patrickvonplaten · Pull Request #12271 · huggingface/transformers · GitHuband a pretraining script should be relatively easy to be merged.(Optional) Desired project outcomeThe best Spanish ASR model.(Optional) ChallengesIt would be nice to use more data than just the Common Voice dataset.
2021-06-30T17:31:51Z
I am in!cc:@patrickvonplaten@valhalla
2021-06-30T17:42:18Z
Awesome, added you both to the team
2021-06-30T19:12:20Z
I am interested on this one as well, if there’s still time to join!
2021-07-01T12:22:46Z
I took part in the Wav2Vec2 fine-tuning week for Spanish, this ismy forum post. Mymodel carddescribes some of the pre-processing and training steps I took.It would be awesome to create a pretrained model using Jax/Flax. I’m not sure I’ll have the time to take part in this one (I already signed up for a different project, and I know nothing about Jax), but I’ll try to follow your discussions if I can. Good luck!