PreTrain Wav2Vec2 in Indonesian
PreTrain Wav2Vec2 in IndonesianThere is currently only a multilingually pre-trained model for Indonesian Wav2Vec2. Therefore we would like to pre-train Wav2Vec2 with only Indonesian datasets.ModelA randomly initialized Wav2Vec2 model (if possible the large model)DatasetsIn addition to the Indonesian Common Voice (18h), we have also collected the following Indonesian speech datasets:Wavenet Synthetic Voice (>400h)TIML-IDN (14.5h)Bible.is (40h)Podcast (>10kh)Available training scriptsFlaxWav2Vec2 will be merged soon:[Flax] Add wav2vec2 by patrickvonplaten · Pull Request #12271 · huggingface/transformers · GitHuband a pretraining script should be relatively easy to be merged.(Optional) Desired project outcomeThe best Indonesian ASR modelTeamWe have a team from the last wav2vec2 event:@cahya@Galuh@Wikidepia@ayameRushia@munggok@yasirabd
2021-06-29T14:00:51Z
Wuhuuu - super excited about this! I’ll make sure a pretraining script is ready until Thursday.Finalizing it!