Update README.md
Browse files
README.md
CHANGED
|
@@ -57,37 +57,8 @@ The model was trained on a Tesla P100 GPU and 25GB of RAM with the following com
|
|
| 57 |
|
| 58 |
## Results:
|
| 59 |
|
| 60 |
-
|
| 61 |
-
| --------- | ----------- |
|
| 62 |
-
| **Exact** | **90.77**48 |
|
| 63 |
-
| **F1** | **94.94**71 |
|
| 64 |
-
|
| 65 |
-
```json
|
| 66 |
-
{
|
| 67 |
-
"exact": 90.77483309730933,
|
| 68 |
-
"f1": 94.94714391266254,
|
| 69 |
-
"total": 69202,
|
| 70 |
-
"HasAns_exact": 86.60850599781898,
|
| 71 |
-
"HasAns_f1": 92.90582885592328,
|
| 72 |
-
"HasAns_total": 45850,
|
| 73 |
-
"NoAns_exact": 98.95512161699212,
|
| 74 |
-
"NoAns_f1": 98.95512161699212,
|
| 75 |
-
"NoAns_total": 23352,
|
| 76 |
-
"best_exact": 90.77483309730933,
|
| 77 |
-
"best_exact_thresh": 0.0,
|
| 78 |
-
"best_f1": 94.94714391266305,
|
| 79 |
-
"best_f1_thresh": 0.0
|
| 80 |
-
}
|
| 81 |
-
```
|
| 82 |
-
|
| 83 |
-
## Comparison:
|
| 84 |
-
|
| 85 |
-
| Model | f1 score |
|
| 86 |
-
| :-------------------------------------------------------------: | :-------: |
|
| 87 |
-
| bert-base-spanish-wwm-cased-finetuned-spa-squad2-es | 86.07 |
|
| 88 |
-
| **distill**-bert-base-spanish-wwm-cased-finetuned-spa-squad2-es | **94.94** |
|
| 89 |
|
| 90 |
-
So, yes, this version is even more accurate.
|
| 91 |
|
| 92 |
### Model in action
|
| 93 |
|
|
|
|
| 57 |
|
| 58 |
## Results:
|
| 59 |
|
| 60 |
+
TBA
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 61 |
|
|
|
|
| 62 |
|
| 63 |
### Model in action
|
| 64 |
|