hat
Konsènan o aza koupe, li se pa sa ki o aza, li pral koupe sou antite HTML, nimewo, punctuations ak HTML. Moun sa yo ki yo se kèk règ ki ka chanje nan dosye a analizeur, epi n ap travay sou amelyorasyon pwosesis la an jeneral. Anplis pwoblèm sa yo ou mansyone gen pwoblèm ki gen rapò ak Context tankou mo ak siyifikasyon doub ak pwoblèm sèks nan kèk lang. Se konsa, repons lan se “toujou ap travay sou sa”.
eng
Regarding random cutting, it is not that random, it will cut on html entities, numbers, punctuations and html. Those are rules that can be changed in the parser file, and we are working on improving the overall process. Besides the problems you mentioned there are problems related to context such as words with dual meaning and gender issues in some languages. So the answer is “still working on that”.