Edit model card
YAML Metadata Error: "language[0]" must only contain lowercase characters
YAML Metadata Error: "language[0]" with value "English" is not valid. It must be an ISO 639-1, 639-2 or 639-3 code (two/three letters), or a special value like "code", "multilingual". If you want to use BCP-47 identifiers, you can specify them in language_bcp47.

roberta-base + SQuAD QA

Objective: This is Roberta Base trained to do the SQuAD Task. This makes a QA model capable of answering questions.

model_name = "thatdramebaazguy/roberta-base-squad"
pipeline(model=model_name, tokenizer=model_name, revision="v1.0", task="question-answering")

Overview

Language model: roberta-base
Language: English
Downstream-task: QA
Training data: SQuADv1
Eval data: SQuAD
Infrastructure: 2x Tesla v100
Code: See example

Hyperparameters

Num examples = 88567  
Num Epochs = 10
Instantaneous batch size per device = 32  
Total train batch size (w. parallel, distributed & accumulation) = 64 

Performance

Eval on SQuADv1

  • epoch = 10.0
  • eval_samples = 10790
  • exact_match = 83.6045
  • f1 = 91.1709

Eval on MoviesQA

  • eval_samples = 5032
  • exact_match = 51.6494
  • f1 = 68.2615

Github Repo:


Downloads last month
36,433
Hosted inference API
This model can be loaded on the Inference API on-demand.