Serega6678 commited on
Commit
41d7d06
1 Parent(s): e09ea3f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -5
README.md CHANGED
@@ -29,14 +29,17 @@ inference: false
29
 
30
  **Metrics:**
31
 
32
- Read more about evaluation protocol & datasets in our [paper](https://arxiv.org/abs/2402.15343) and [blog post](https://www.numind.ai/blog/a-foundation-model-for-entity-recognition).
 
 
33
 
34
- | Model | F1 macro |
35
  |----------|----------|
36
- | RoBERTa-base | 0.7129 |
37
- | ours | 0.7500 |
38
- | ours + two emb | 0.7686 |
39
 
 
40
 
41
  ## Usage
42
 
 
29
 
30
  **Metrics:**
31
 
32
+ Here is the aggregated performance of the models over several datasets.
33
+
34
+ k=X means that as a training data, we took only X examples for each class, trained the model, and evaluated it on the full test set.
35
 
36
+ | Model | k=1 | k=4 | k=16 | k=64 |
37
  |----------|----------|
38
+ | RoBERTa-base | 24.5 | 44.7 | 58.1 | 65.4
39
+ | RoBERTa-base + NER-BERT pre-training | 32.3 | 50.9 | 61.9 | 67.6 |
40
+ | NuNER v1.0 | 39.4 | 59.6 | 67.8 | 71.5 |
41
 
42
+ Read more about evaluation protocol & datasets in our [paper](https://arxiv.org/abs/2402.15343) and [blog post](https://www.numind.ai/blog/a-foundation-model-for-entity-recognition).
43
 
44
  ## Usage
45