Hugging Face's logo

antoniocappiello
/
bert-base-italian-uncased-squad-it

Question Answering Transformers PyTorch Italian Inference Endpoints
Model card Files Community
1
system HF staff commited on
Commit
27b6d93
•
1 Parent(s): 794c0e2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -4
README.md CHANGED
@@ -46,8 +46,16 @@ python ./examples/run_squad.py \
46
  --do_lower_case \
47
  ```
48
 
49
- ## Eval results
50
 
51
- | Model | batch | EM | F1 |
52
- | ------------- |:-----:|:-----:| -----:|
53
- | BERT base uncased | 3 | **63.8** | **75.30** |
 
 
 
 
 
 
 
 
46
  --do_lower_case \
47
  ```
48
 
49
+ ## Eval Results
50
 
51
+ | Metric | # Value |
52
+ | ------ | --------- |
53
+ | **EM** | **63.8** |
54
+ | **F1** | **75.30** |
55
+
56
+ ## Comparison
57
+
58
+ | Model | EM | F1 score |
59
+ | -------------------------------------------------------------------------------------------------------------------------------- | --------- | --------- |
60
+ | [DrQA-it trained on SQuAD-it](https://github.com/crux82/squad-it/blob/master/README.md#evaluating-a-neural-model-over-squad-it) | 56.1 | 65.9 |
61
+ | This one | **63.8** | **75.30** |