Update README.md
Browse files
README.md
CHANGED
@@ -4,7 +4,7 @@ license: mit
|
|
4 |
datasets:
|
5 |
- Jean-Baptiste/wikiner_fr
|
6 |
widget:
|
7 |
-
- text: "Boulanger, habitant à Boulanger et travaillant dans le magasin Boulanger situé dans la ville de Boulanger. Boulanger a écrit notamment le très célèbre livre Boulanger édité par
|
8 |
---
|
9 |
DistilCamemBERT-NER
|
10 |
===================
|
@@ -38,12 +38,12 @@ Benchmark
|
|
38 |
|
39 |
This model performance is compared to 3 reference models (see below) with the metric [MCC (Matthews Correlation Coefficient)](https://en.wikipedia.org/wiki/Phi_coefficient). The score is given with a factor x100 and the delta gain with DistilCamemBERT-NER used in reference is in parantheses. For the mean inference time measure, an AMD Ryzen 5 4500U @ 2.3GHz with 6 cores was used:
|
40 |
|
41 |
-
| **model** | **PER** | **LOC** | **ORG** | **MISC** | **O** |
|
42 |
-
| :---------------------------------------------------------------------------------------------------------------: | :--------------: | :--------------: | :--------------: | :--------------: | :------------- : |
|
43 |
-
| [cmarkea/distilcamembert-base-ner](https://huggingface.co/cmarkea/distilcamembert-base-ner) | 93.91
|
44 |
-
| [Jean-Baptiste/camembert-ner](https://huggingface.co/Jean-Baptiste/camembert-ner) | 95.20<br/>(+1%) | 90.85<br/>(+3%) | 89.50<br/>(+6%) | 89.02<br/>(+8%) | 92.86<br/>(+2%) |
|
45 |
-
| [Davlan/bert-base-multilingual-cased-ner-hrl](https://huggingface.co/Davlan/bert-base-multilingual-cased-ner-hrl) | 79.93<br/>(-15%) | 70.39<br/>(-22%) | 60.26<br/>(-28%) | n/a<br/>(n/a%) | 69.95<br/>(-24%) |
|
46 |
-
| [flair/ner-french](https://huggingface.co/flair/ner-french) | 80.18<br/>(-15%) | 72.11<br/>(-18%) | 67.29<br/>(-20%) | 72.39<br/>(-17%) | 74.34<br/>(-19%) |
|
47 |
|
48 |
How to use DistilCamemBERT-NER
|
49 |
------------------------------
|
|
|
4 |
datasets:
|
5 |
- Jean-Baptiste/wikiner_fr
|
6 |
widget:
|
7 |
+
- text: "Boulanger, habitant à Boulanger et travaillant dans le magasin Boulanger situé dans la ville de Boulanger. Boulanger a écrit notamment le très célèbre livre Boulanger édité par la maison d'édition Boulanger."
|
8 |
---
|
9 |
DistilCamemBERT-NER
|
10 |
===================
|
|
|
38 |
|
39 |
This model performance is compared to 3 reference models (see below) with the metric [MCC (Matthews Correlation Coefficient)](https://en.wikipedia.org/wiki/Phi_coefficient). The score is given with a factor x100 and the delta gain with DistilCamemBERT-NER used in reference is in parantheses. For the mean inference time measure, an AMD Ryzen 5 4500U @ 2.3GHz with 6 cores was used:
|
40 |
|
41 |
+
| **model** | **time (ms)** | **PER** | **LOC** | **ORG** | **MISC** | **O** |
|
42 |
+
| :---------------------------------------------------------------------------------------------------------------: | :----------------: | :--------------: | :--------------: | :--------------: | :--------------: | :------------- : |
|
43 |
+
| [cmarkea/distilcamembert-base-ner](https://huggingface.co/cmarkea/distilcamembert-base-ner) | **43.44** | **93.91** | **88.26** | **84.03** | **82.74** | **91.45** |
|
44 |
+
| [Jean-Baptiste/camembert-ner](https://huggingface.co/Jean-Baptiste/camembert-ner) | 83.70<br/>(+93%) | 95.20<br/>(+1%) | 90.85<br/>(+3%) | 89.50<br/>(+6%) | 89.02<br/>(+8%) | 92.86<br/>(+2%) |
|
45 |
+
| [Davlan/bert-base-multilingual-cased-ner-hrl](https://huggingface.co/Davlan/bert-base-multilingual-cased-ner-hrl) | 87.56<br/>(+102%) | 79.93<br/>(-15%) | 70.39<br/>(-22%) | 60.26<br/>(-28%) | n/a<br/>(n/a%) | 69.95<br/>(-24%) |
|
46 |
+
| [flair/ner-french](https://huggingface.co/flair/ner-french) | 314.96<br/>(+625%) | 80.18<br/>(-15%) | 72.11<br/>(-18%) | 67.29<br/>(-20%) | 72.39<br/>(-17%) | 74.34<br/>(-19%) |
|
47 |
|
48 |
How to use DistilCamemBERT-NER
|
49 |
------------------------------
|