PreTrain Electra/T5 for Korean from scratch
PreTrain Electra/T5 for Korean from scratchThis project will be train the pretrained-model (Electra, T5, …) from Korean corpus called as a 모두의말뭉치.2. LanguageThe model will be trained in Korean.3. ModelElectraT54. Datasets모두의말뭉치5. Training scriptsWe can make use ofexampleto train the model.>Addtionaly, we will be make the train codes origin from the transformers example7. Desired project outcomeA pretrained weights. After, fine-tune both text classification and text summarization
2021-07-01T15:54:48Z
I’m interested in pretrained korean model, too! I wanna join in. ol
2021-07-01T18:22:25Z
Awesome, finalizing you guys!
2021-07-02T07:45:49Z
Good! I’d like to join this.