NER - aggregation_strategy
I have custom trained a distilBERT NER model for extracting skills from Job Descriptions.I am using aggregation_strategy = first.There are my model resultsimage1443×592 16.9 KBThe issues I am facing :The entity extraction fails, if the input text contains entities with space i.e., if we input ‘machine learning’ instead of ‘machinelearning’, the model ends up extracting only machine as a skill.Aggregation is grouping phrases in the sentence together.For example :These issues persist with other aggregation strategies also i.e., simple/average/maxAny thoughts on why this is happening, and how to resolve this.Thanks
2024-01-24T19:07:24Z
Hey im working on the same project and it would help me greatly if you could lend me a hand on how you did it. Im kinda lost