Pretrain Wav2vec2 in Russian
Pretrain Wav2vec2 in RussianThere is currently only a multilingually pretrained model for Russian Wav2Vec2. Let’s make a Wav2Vec2 only pretrained on Russian.2. LanguageThe model will be trained in Russian.3. ModelA randomly initialized Wav2Vec2 model4. DatasetsPart of CommonVoice -CommonVoice- 35hSberGolos -Golos- 1095hSovaDataset -SovaDataset- 400h5. Training scriptsWe can make use ofrun_wav2vec2_pretrain_flaxto train the model.6. (Optional) ChallengesDataset have many hours, training will take a long time7. (Optional) Desired project outcomeThe best Russian ASR model.
2021-06-30T22:52:07Z
@anton-l:jax:
2021-07-01T09:57:04Z
Would be awesome to see this happen!