PreTrain Wav2Vec2 in Turkish
PreTrain Wav2Vec2 in TurkishOn the previous community event I pretrained aTurkish Wav2Vec2 modelusing the fairseq script. This is a subpar model because I hadn’t cleaned the data.This time I want to do it properly with the freshly mergedFlaxWav2Vec2 + PreTraining scriptModelA randomly initialized Wav2Vec2 modelDatasetsOne can make useCommon Voicethe dataset is also available through thedatasetslibrary here:common_voice · Datasets at Hugging Face.Available training scriptsFlaxWav2Vec2 will be merged soon:[Flax] Add wav2vec2 by patrickvonplaten · Pull Request #12271 · huggingface/transformers · GitHuband a pretraining script should be relatively easy to be merged.(Optional) Desired project outcomeThe best Turkish ASR model.(Optional) ChallengesI have some additional scraped audiobook data. Might need a bit more though.
2021-07-02T15:32:47Z
This is a well-defined topic, let’s define it as well!