PreTrain RoBERTa for Kannada
RoBERTa for KannadaCurrently, there are only two models available for hate speech detection in the hugging face model hub. By pre-training a RoBERTa model, we wish to increase the accessibility to one of the oldest Indic languages.2. LanguageKannada3. ModelA randomly Initialized RoBERTa model.4. DatasetsHere are some of the datasets containing Kannada sentences: preprocessing required.Automate Text-based Workflows at Scale5. Training scriptsA masked language modeling script for Flax is availablehere. Probably the same can be used.6. Desired project outcomeTo use this model and fine-tune it for a sentiment analysis task for Kannada text sentences.
2021-07-01T21:41:41Z
More datasets containing Kannada sentences :Kannada News Dataset | KaggleKannada Covid-19 Sentiment Analysis Dataset | Kaggle
2021-07-01T21:42:33Z
Some more datasets :Kannada Wikipedia Articles | KaggleSamanantar | Kaggle
2021-07-02T15:34:12Z
Let’s define it!