File size: 437 Bytes
dba5a0a c18455a |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 |
---
tags:
- Issue_fixed
- textattack
- textclassification
- entailment
license: mit
datasets:
- mnli
metrics:
- accuracy
---
Fixed label mapping issue for textattack/bert-base-uncased-MNLI, if using the original model, the predicted label has systematic confusion with the huggingface MNLI dataset. See the Github issue: https://github.com/QData/TextAttack/issues/684. The fixed accuracy_mm is 84.44% and is 7% before the fix applied. |