Tokenizers How do you extract concatenated entity words from B-ORG and I-ORGs etc
I do not comprehend why these words are split into several words e.g. Chevron shows a three entitiesB-ORG Ch and I-ORG ##evand I-ORG ##ron. This is completely useless.How do you go about putting back these words together in order to be able to use them later?