Serega6678
commited on
Commit
•
41d7d06
1
Parent(s):
e09ea3f
Update README.md
Browse files
README.md
CHANGED
@@ -29,14 +29,17 @@ inference: false
|
|
29 |
|
30 |
**Metrics:**
|
31 |
|
32 |
-
|
|
|
|
|
33 |
|
34 |
-
| Model |
|
35 |
|----------|----------|
|
36 |
-
| RoBERTa-base |
|
37 |
-
|
|
38 |
-
|
|
39 |
|
|
|
40 |
|
41 |
## Usage
|
42 |
|
|
|
29 |
|
30 |
**Metrics:**
|
31 |
|
32 |
+
Here is the aggregated performance of the models over several datasets.
|
33 |
+
|
34 |
+
k=X means that as a training data, we took only X examples for each class, trained the model, and evaluated it on the full test set.
|
35 |
|
36 |
+
| Model | k=1 | k=4 | k=16 | k=64 |
|
37 |
|----------|----------|
|
38 |
+
| RoBERTa-base | 24.5 | 44.7 | 58.1 | 65.4
|
39 |
+
| RoBERTa-base + NER-BERT pre-training | 32.3 | 50.9 | 61.9 | 67.6 |
|
40 |
+
| NuNER v1.0 | 39.4 | 59.6 | 67.8 | 71.5 |
|
41 |
|
42 |
+
Read more about evaluation protocol & datasets in our [paper](https://arxiv.org/abs/2402.15343) and [blog post](https://www.numind.ai/blog/a-foundation-model-for-entity-recognition).
|
43 |
|
44 |
## Usage
|
45 |
|