Sentiment analysis of Sinhala language using deep learning networks
Sentiment analysis of Sinhala language using deep learning networks1. DescriptionThe main objective of the project is to test deep learning models to identify the sentiments in Sinhala text. A Facebook dataset is used to train and test the models. The model codes are already developed and only the training and testing phases remain to be done. Since Sinhala remains as a resource poor NLP language, this project will lend a hand to improve the current tools and provide insight on the current state.Migrating the current code into JAX with the use of Flax, Haiku and other libraries is another objective. Libraries like Trax with basic deep learning models and the trending Transformers are aimed to be tested.2. LanguageThe models are trained in Sinhala Language3. ModelThe models that will be tested areRNNLSTMGRUBiLSTMBaseline  models  with  the  combination  of  a CNNStacked LSTM and BiLSTMHAHNNCapsule networks4. DatasetA Facebook dataset contaning 526,732 Sinhala and English posts extracted from CrowdTangle . The dataset consists of a decade’s worth of content from Facebook pages popular in Sri Lanka.5. Training scriptsThe following links contain the model scriptsMain models6. ChallengesThere are several models that needs to be adjusted and tested7. Desired project outcomePerformance measures of each model8. ReadsThe following links can be useful to better understand the project andwhat has been done previously.https://sencat.lk/
2021-06-30T17:55:25Z
If the proposal is good enough can you please accept this project?@Suzana@valhalla@osanseviero@patrickvonplaten
2021-07-01T10:12:10Z
Thanks for the cool proposal@graw!The project is really coolJust regarding the models, we don’t really have any of those implemented in Transformers, so this might take some time…Would it be sensible to pretrain a RoBERTa model + finetune it afterwards maybe?Given that the project lasts only a week, maybe implementing + trying out all those models is a bit time-consuming
2021-07-01T10:12:25Z
puttting you guys down though officially
2021-07-01T10:13:20Z
Also do you have links to the dataset?
2021-07-01T11:34:40Z
Thank you so much, you are a life savior. It is fine about the Transformer part. I will work on it afterwards. The database is not technically available for the public because of the new Facebook regulations. I am able to provide it to my teammates but not make it public. However I can add the paper regarding the dataset and if you are interested you can ask from the original authors for access.Dataset paper