How to get NER pipeline output to match with spacy's output?
Hi all,In a prod setup, I am already using transformers, and need to have NER for a task. But the issue I’m facing is that unlikespacy, here the NER is at token level. What could be the quickest way or postprocessing to generate an output like spacy does (with char indices, at string level)?image1085×536 81 KBAnd thanks for hosting this forum. Just like other discourse forums, we can now ask all the simple curiosity questions without treating it as an “issue” on github.
2020-07-12T08:25:11Z
hi@crazydivThank you for joining the forumI think this issue is fixed inthisPR
2020-07-12T09:01:44Z
Thanks. I was looking for the flaggrouped_entities=True. It isn’t documented intask summary. It is there insource defbut not explained in parameters, so I missed it.nlp = pipeline("ner", grouped_entities=True)Out of curiosity, you read about this in docs somewhere or happen to know this flag because you were following the related PR you referred?
2020-07-12T09:51:23Z
Yes, it’s not documented yet. I was following the PR.Feel free to open a PR and add it in docscc@sgugger