Commit
•
074d9b5
1
Parent(s):
4b15c4c
Update README.md
Browse files
README.md
CHANGED
@@ -53,14 +53,11 @@ training_args = TrainingArguments(
|
|
53 |
The model was evaluated using the test sets for MultiNLI and ANLI and the dev set for Fever-NLI
|
54 |
dataset | accuracy
|
55 |
-------|---------
|
56 |
-
|
57 |
fever-nli | 0.777
|
58 |
anli-all | 0.579
|
59 |
anli-r3 | 0.495
|
60 |
|
61 |
-
accuracy (balanced) | F1 (weighted) | precision | recall | accuracy (not balanced)
|
62 |
-
-------|---------|----------|---------|----------
|
63 |
-
0.745 | 0.773 | 0.772 | 0.771 | 0.771
|
64 |
|
65 |
## Limitations and bias
|
66 |
Please consult the original DeBERTa paper and literature on different NLI datasets for potential biases.
|
|
|
53 |
The model was evaluated using the test sets for MultiNLI and ANLI and the dev set for Fever-NLI
|
54 |
dataset | accuracy
|
55 |
-------|---------
|
56 |
+
mnli_m_mm | 0.903/0.903
|
57 |
fever-nli | 0.777
|
58 |
anli-all | 0.579
|
59 |
anli-r3 | 0.495
|
60 |
|
|
|
|
|
|
|
61 |
|
62 |
## Limitations and bias
|
63 |
Please consult the original DeBERTa paper and literature on different NLI datasets for potential biases.
|