File size: 1,121 Bytes
ef8ede1 2f47b66 ef8ede1 6154d19 7a99f0f 6154d19 ca51175 6154d19 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 |
---
datasets:
- cjvt/si_nli
language:
- sl
license: cc-by-sa-4.0
---
# CrossEncoder for Slovene NLI
The model was trained using the [SentenceTransformers](https://sbert.net/) [CrossEncoder](https://www.sbert.net/examples/applications/cross-encoder/README.html) class. <br />
It is based on [SloBerta](https://huggingface.co/EMBEDDIA/sloberta), a monolingual Slovene model.
## Training
This model was trained on the [SI-NLI](https://huggingface.co/datasets/cjvt/si_nli) dataset.<br />
More details and the training script are available here: [repo](https://github.com/jacinthes/slovene-nli-benchmark)
## Performance
The model achieves the following metrics:
- Test accuracy: 75.95
- Dev accuracy: 75.14
## Usage
The model can be used for inference using the below code:
```python
from sentence_transformers import CrossEncoder
model = CrossEncoder('jacinthes/cross-encoder-sloberta-si-nli')
premise = 'Pojdi z menoj v toplice.'
hypothesis = 'Bova lepa bova fit.'
prediction = model.predict([premise, hypothesis])
int2label = {0: 'entailment', 1: 'neutral', 2:'contradiction'}
print(int2label[prediction.argmax()])
``` |