Single Best Answer question classifier
This model classifies multiple choice questions as Single-Best-Answer MCQs or not. SBA are MCQs where the question requires selecting the best or most correct answer among the set of choices.
The model is trained on 3K labeled questions from MMLU, MMLU_redux, and MMLU_pro benchmarks.
The model aligns with manual annotation (recall: 0.97, precision:0.93)
TODO: link to the paper preprint when it is published.
- Downloads last month
- 3,322
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model's library.
Model tree for ahmedselhady/bert-base-uncased-sba-clf
Base model
google-bert/bert-base-uncased