Update README.md
Browse files
README.md
CHANGED
@@ -280,12 +280,14 @@ You can finetune this model on your own dataset.
|
|
280 |
| **cosine_accuracy** | **0.994** |
|
281 |
|
282 |
#### Retrieval tasks compared to original numbers in the paper
|
|
|
283 |
| | NFCorpus | SciFact | TREC-Covid | FiQA | ArguAna | SciDocs | FEVER | Climate-FEVER | MLDR - OOD |
|
284 |
|:-----------------------: |:--------: |:-------: |:----------: |:-----: |:-------: |:-------: |------- |--------------- |:----------: |
|
285 |
| ModernBERT-base | 23.7 | 57.0 | 72.1 | 28.8 | 35.7 | 12.5 | 59.9 | 23.6 | 27.4 |
|
286 |
| ModernBERT-base (ours) | 26.6 | 61.6 | 71.4 | 30.7 | 46.3 | 13.6 | 65.7 | 22.6 | 30.5 |
|
287 |
| ModernBERT-large | 26.2 | 60.4 | 74.1 | 33.1 | 38.2 | 13.8 | 62.7 | 20.5 | 34.3 |
|
288 |
| ModernBERT-large (ours) | 28.4 | 63.6 | 77.4 | 34.3 | 47.7 | 15.7 | 68.2 | 22.9 | 38.9 |
|
|
|
289 |
<!--
|
290 |
## Bias, Risks and Limitations
|
291 |
|
|
|
280 |
| **cosine_accuracy** | **0.994** |
|
281 |
|
282 |
#### Retrieval tasks compared to original numbers in the paper
|
283 |
+
|
284 |
| | NFCorpus | SciFact | TREC-Covid | FiQA | ArguAna | SciDocs | FEVER | Climate-FEVER | MLDR - OOD |
|
285 |
|:-----------------------: |:--------: |:-------: |:----------: |:-----: |:-------: |:-------: |------- |--------------- |:----------: |
|
286 |
| ModernBERT-base | 23.7 | 57.0 | 72.1 | 28.8 | 35.7 | 12.5 | 59.9 | 23.6 | 27.4 |
|
287 |
| ModernBERT-base (ours) | 26.6 | 61.6 | 71.4 | 30.7 | 46.3 | 13.6 | 65.7 | 22.6 | 30.5 |
|
288 |
| ModernBERT-large | 26.2 | 60.4 | 74.1 | 33.1 | 38.2 | 13.8 | 62.7 | 20.5 | 34.3 |
|
289 |
| ModernBERT-large (ours) | 28.4 | 63.6 | 77.4 | 34.3 | 47.7 | 15.7 | 68.2 | 22.9 | 38.9 |
|
290 |
+
|
291 |
<!--
|
292 |
## Bias, Risks and Limitations
|
293 |
|