YAML Metadata Error:
"language[0]" must only contain lowercase characters
YAML Metadata Error:
"language[0]" with value "English" is not valid. It must be an ISO 639-1, 639-2 or 639-3 code (two/three letters), or a special value like "code", "multilingual". If you want to use BCP-47 identifiers, you can specify them in language_bcp47.
roberta-base + SQuAD QA
Objective: This is Roberta Base trained to do the SQuAD Task. This makes a QA model capable of answering questions.
model_name = "thatdramebaazguy/roberta-base-squad"
pipeline(model=model_name, tokenizer=model_name, revision="v1.0", task="question-answering")
Overview
Language model: roberta-base
Language: English
Downstream-task: QA
Training data: SQuADv1
Eval data: SQuAD
Infrastructure: 2x Tesla v100
Code: See example
Hyperparameters
Num examples = 88567
Num Epochs = 10
Instantaneous batch size per device = 32
Total train batch size (w. parallel, distributed & accumulation) = 64
Performance
Eval on SQuADv1
- epoch = 10.0
- eval_samples = 10790
- exact_match = 83.6045
- f1 = 91.1709
Eval on MoviesQA
- eval_samples = 5032
- exact_match = 51.6494
- f1 = 68.2615
Github Repo:
- Downloads last month
- 36,433