What is the position of this model in MTEB leaderboard?
#31
by
deepak-banka
- opened
What is the position of this model in MTEB leaderboard?
While this model will produce embeddings, it hasn't been fine-tuned to produce embeddings for tasks measured by MTEB. So in this state it probably does not do well on this benchmark. I recommend reading up on text-embedding pre-training and fine-tuning: https://arxiv.org/pdf/2212.03533
A couple discussions down (past the spam), there is this thread, where some examples of IR dataset finetuning has taken place already: https://huggingface.co/answerdotai/ModernBERT-base/discussions/13
See the model list here, and you can see which place where on MTEB by looking up the model name and the task/dataset: https://huggingface.co/models?library=sentence-transformers&other=modernbert