Commit
·
074d9b5
1
Parent(s):
4b15c4c
Update README.md
Browse files
README.md
CHANGED
|
@@ -53,14 +53,11 @@ training_args = TrainingArguments(
|
|
| 53 |
The model was evaluated using the test sets for MultiNLI and ANLI and the dev set for Fever-NLI
|
| 54 |
dataset | accuracy
|
| 55 |
-------|---------
|
| 56 |
-
|
| 57 |
fever-nli | 0.777
|
| 58 |
anli-all | 0.579
|
| 59 |
anli-r3 | 0.495
|
| 60 |
|
| 61 |
-
accuracy (balanced) | F1 (weighted) | precision | recall | accuracy (not balanced)
|
| 62 |
-
-------|---------|----------|---------|----------
|
| 63 |
-
0.745 | 0.773 | 0.772 | 0.771 | 0.771
|
| 64 |
|
| 65 |
## Limitations and bias
|
| 66 |
Please consult the original DeBERTa paper and literature on different NLI datasets for potential biases.
|
|
|
|
| 53 |
The model was evaluated using the test sets for MultiNLI and ANLI and the dev set for Fever-NLI
|
| 54 |
dataset | accuracy
|
| 55 |
-------|---------
|
| 56 |
+
mnli_m_mm | 0.903/0.903
|
| 57 |
fever-nli | 0.777
|
| 58 |
anli-all | 0.579
|
| 59 |
anli-r3 | 0.495
|
| 60 |
|
|
|
|
|
|
|
|
|
|
| 61 |
|
| 62 |
## Limitations and bias
|
| 63 |
Please consult the original DeBERTa paper and literature on different NLI datasets for potential biases.
|