Update README.md
Browse files
README.md
CHANGED
@@ -27,24 +27,24 @@ Evaluation results
|
|
27 |
|
28 |
| **class** | **precision (%)** | **recall (%)** | **f1 (%)** | **support (#sub-word)** |
|
29 |
| :------------: | :---------------: | :------------: | :--------: | :---------------------: |
|
30 |
-
| **global** | 98.
|
31 |
-
| **PER** | 96.
|
32 |
-
| **LOC** |
|
33 |
-
| **ORG** |
|
34 |
-
| **MISC** | 88.
|
35 |
-
| **O** | 99.
|
36 |
|
37 |
Benchmark
|
38 |
---------
|
39 |
|
40 |
-
This model performance is compared to
|
41 |
|
42 |
-
| **model** | **time (ms)**
|
43 |
| :---------------------------------------------------------------------------------------------------------------: | :----------------: | :--------------: | :--------------: | :--------------: | :--------------: | :------------- : |
|
44 |
-
| [cmarkea/distilcamembert-base-ner](https://huggingface.co/cmarkea/distilcamembert-base-ner) | **43.44**
|
45 |
-
| [
|
46 |
-
| [
|
47 |
-
|
48 |
|
49 |
How to use DistilCamemBERT-NER
|
50 |
------------------------------
|
|
|
27 |
|
28 |
| **class** | **precision (%)** | **recall (%)** | **f1 (%)** | **support (#sub-word)** |
|
29 |
| :------------: | :---------------: | :------------: | :--------: | :---------------------: |
|
30 |
+
| **global** | 98.17 | 98.19 | 98.18 | 378'776 |
|
31 |
+
| **PER** | 96.78 | 96.87 | 96.82 | 23'754 |
|
32 |
+
| **LOC** | 94.05 | 93.59 | 93.82 | 27'196 |
|
33 |
+
| **ORG** | 86.05 | 85.92 | 85.98 | 6'526 |
|
34 |
+
| **MISC** | 88.78 | 84.69 | 86.69 | 11'891 |
|
35 |
+
| **O** | 99.26 | 99.47 | 99.37 | 309'409 |
|
36 |
|
37 |
Benchmark
|
38 |
---------
|
39 |
|
40 |
+
This model performance is compared to 3 reference models (see below) with the metric f1 score. For the mean inference time measure, an AMD Ryzen 5 4500U @ 2.3GHz with 6 cores was used:
|
41 |
|
42 |
+
| **model** | **time (ms)** | **PER (%)** | **LOC (%)** | **ORG (%)** | **MISC (%)** | **O (%)** |
|
43 |
| :---------------------------------------------------------------------------------------------------------------: | :----------------: | :--------------: | :--------------: | :--------------: | :--------------: | :------------- : |
|
44 |
+
| [cmarkea/distilcamembert-base-ner](https://huggingface.co/cmarkea/distilcamembert-base-ner) | **43.44** | 96.82 | 93.82 | 85.98 | 86.69 | 99.37 |
|
45 |
+
| [Jean-Baptiste/camembert-ner](https://huggingface.co/Jean-Baptiste/camembert-ner) | 88.49 | **98.82** | **97.35** | **95.03** | **95.34** | **99.67** |
|
46 |
+
| [Davlan/bert-base-multilingual-cased-ner-hrl](https://huggingface.co/Davlan/bert-base-multilingual-cased-ner-hrl) | 87.56 | 79.93 | 72.89 | 61.34 | n/a | 96.04 |
|
47 |
+
| [flair/ner-french](https://huggingface.co/flair/ner-french) | 314.96 | 83.55 | 78.13 | 74.19 | 77.13 | 97.88 |
|
48 |
|
49 |
How to use DistilCamemBERT-NER
|
50 |
------------------------------
|