Imbalanced data in ner task
Hi!I have imbalanced dataset size N with such classes:class 1 - 0.554*Nclass 2 - 0.271*Nclass 3 - 0.185*NI’m trying to solve NER task by fine-tuning Bert “dslim / bert-large-NER”, but during training my f1 score doesn’t rise above 0.53. I use Trainer from TransformersIs there any ways to get f1=0.8?How could I use weights in Trainer loss function?It’s really difficult to use up/down sampling