Model for Bengali Poetry Generation with GPT-2
GPT-2 for Bengali Poetry GenerationDescriptionIn this project, I propose to generateBengalipoetry using a GPT-2 model trained from scratch.As TPUv3-8 will be used, this should not take much time.After a model has been trained, I will use the model to fine-tune with poems written in Bengali.DatasetsThe model can leverage multiple Datasets:TheBangla Wikipedia Corpusdataset available on KagglePoems available in the public domain of poets such asJibananda Dash,Rabindranath Tagore,Michael Madhusudan Dutt, etc.Available Training ScriptsI believe thistraining scriptcan be used to train the model.Desired project outcomeThe goal of the project would be to be able to generate Bengali poetry sensible enough to fool humans into thinking a poet wrote it.ChallengesAs there is no pretrained GPT-2 model that exists, it might take a while longer to train it from scratch, and then fine-tuning it poetry.The format of the data is different for different websites.Some authors (Tagore) have much more voluminous contributions to the literature than others (Madhusudan Dutt). Their writing style will disproportionately influence the model.Suggested ReadingBengali Poem Generation Using Deep Learning ApproachPoetic Machine: Computational Creativity for Automatic Poetry Generation in BengaliSequence-to-sequence Bangla Sentence Generation with LSTM Recurrent Neural NetworksContext-driven Bengali Text Generation using Conditional Language ModelTraining an AI to create poetry (NLP Zero to Hero - Part 6)NLP with Bangla: Generating Text and Sentiment Analysis
2021-07-01T12:07:25Z
@patrickvonplatenany update on this project being greenlit?
2021-07-02T15:35:24Z
Let’s define it!
2021-07-02T15:49:21Z
You might want to combine it with the pretraining gpt2 bengali project too. discord channel :#bengali-GPT2
2021-07-02T15:55:00Z
I was thinking about reaching out to them, actually.It would be great to collaborate and share knowledge on common tasks- viz. training GPT-2 for Bengali.Thanks. I will drop by later.@Tahsin-Mayeesha