PreTrain Wav2Vec2 in Persian
PreTrain Wav2Vec2 in PersianThere is currently only a multilingually pretrained model for Persian Wav2Vec2. Let’s make a Wav2Vec2 only pretrained on Persian.ModelA randomly initialized Wav2Vec2 modelDatasetsOne can make use ofCommon Voicethe dataset is also available through thedatasetslibrary here:common_voice · Datasets at Hugging Face.Available training scriptsFlaxWav2Vec2 will be merged soon:[Flax] Add wav2vec2 by Patrickvonplaten · Pull Request #12271 · huggingface/transformers · GitHuband a pretraining script should be relatively easy to be merged.(Optional) Desired project outcomeThe best Persian ASR model.(Optional) ChallengesIt might make sense to use more data than just the common voice.