Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely: It has been argued that recurrent neural network language models are better in capturing long-range dependency than n-gram language models. ,  attempt to verify this claim by investigating the prediction accuracy and the perplexity of these language models as a function of word position, i.e., the position of a word in a sentence. It is expected that as word position increases, the advantage of using recurrent neural network language models over n-gram language models will become more and more evident. On the text corpus of Penn Tree Bank (PTB), a recurrent neural network language model outperforms a trigram language model in both perplexity and word prediction. Hover, on the AMI meeting corpus, a trigram outperforms a recurrent neural network language model.
['Tzu-Hsuan Tseng', 'Tzu-Hsuan Yang', 'Chia-Ping Chen']
I am writing a research paper on a idea Verifying the long-range dependency of RNN language models
[{"from": "human", "value": "I am writing a research paper on a idea Verifying the long-range dependency of RNN language models"}, {"from": "gpt", "value": "Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely: It has been argued that recurrent neural network language models are better in capturing long-range dependency than n-gram language models. ,  attempt to verify this claim by investigating the prediction accuracy and the perplexity of these language models as a function of word position, i.e., the position of a word in a sentence. It is expected that as word position increases, the advantage of using recurrent neural network language models over n-gram language models will become more and more evident. On the text corpus of Penn Tree Bank (PTB), a recurrent neural network language model outperforms a trigram language model in both perplexity and word prediction. Hover, on the AMI meeting corpus, a trigram outperforms a recurrent neural network language model."}]