Research on Repetitive Word Segmentation Existed in Omni-Word Segmentation for Written Chinese
This paper gave a research on repetitive word segmentation that existed universally in omni-word segmentation for written Chinese. Firstly this paper gave the definition of the repetitive word segmentation, then pointed out that word segmentation ambiguity was the necessary reason causing it and making it existed universally and inevitably in Omni-word segmentation. Furthermore,this paper discussed two alternative methods to overcome the repetitive word segmentation, and finally gave an experiment on its proportion and influence on Omni-word segmentation. The result proved a ratio of 87% in proportion and a decrease of 84% in segmentation time.