Cyrile commited on
Commit
5c836b0
1 Parent(s): f03f440

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -7
README.md CHANGED
@@ -4,7 +4,7 @@ license: mit
4
  datasets:
5
  - Jean-Baptiste/wikiner_fr
6
  widget:
7
- - text: "Boulanger, habitant à Boulanger et travaillant dans le magasin Boulanger situé dans la ville de Boulanger. Boulanger a écrit notamment le très célèbre livre Boulanger édité par le maison d'édition Boulanger."
8
  ---
9
  DistilCamemBERT-NER
10
  ===================
@@ -38,12 +38,12 @@ Benchmark
38
 
39
  This model performance is compared to 3 reference models (see below) with the metric [MCC (Matthews Correlation Coefficient)](https://en.wikipedia.org/wiki/Phi_coefficient). The score is given with a factor x100 and the delta gain with DistilCamemBERT-NER used in reference is in parantheses. For the mean inference time measure, an AMD Ryzen 5 4500U @ 2.3GHz with 6 cores was used:
40
 
41
- | **model** | **PER** | **LOC** | **ORG** | **MISC** | **O** | **time (ms)** |
42
- | :---------------------------------------------------------------------------------------------------------------: | :--------------: | :--------------: | :--------------: | :--------------: | :------------- : | :----------------: |
43
- | [cmarkea/distilcamembert-base-ner](https://huggingface.co/cmarkea/distilcamembert-base-ner) | 93.91 | 88.26 | 84.03 | 82.74 | 91.45 | 43.44 |
44
- | [Jean-Baptiste/camembert-ner](https://huggingface.co/Jean-Baptiste/camembert-ner) | 95.20<br/>(+1%) | 90.85<br/>(+3%) | 89.50<br/>(+6%) | 89.02<br/>(+8%) | 92.86<br/>(+2%) | 83.70<br/>(+93%) |
45
- | [Davlan/bert-base-multilingual-cased-ner-hrl](https://huggingface.co/Davlan/bert-base-multilingual-cased-ner-hrl) | 79.93<br/>(-15%) | 70.39<br/>(-22%) | 60.26<br/>(-28%) | n/a<br/>(n/a%) | 69.95<br/>(-24%) | 87.56<br/>(+102%) |
46
- | [flair/ner-french](https://huggingface.co/flair/ner-french) | 80.18<br/>(-15%) | 72.11<br/>(-18%) | 67.29<br/>(-20%) | 72.39<br/>(-17%) | 74.34<br/>(-19%) | 314.96<br/>(+625%) |
47
 
48
  How to use DistilCamemBERT-NER
49
  ------------------------------
 
4
  datasets:
5
  - Jean-Baptiste/wikiner_fr
6
  widget:
7
+ - text: "Boulanger, habitant à Boulanger et travaillant dans le magasin Boulanger situé dans la ville de Boulanger. Boulanger a écrit notamment le très célèbre livre Boulanger édité par la maison d'édition Boulanger."
8
  ---
9
  DistilCamemBERT-NER
10
  ===================
 
38
 
39
  This model performance is compared to 3 reference models (see below) with the metric [MCC (Matthews Correlation Coefficient)](https://en.wikipedia.org/wiki/Phi_coefficient). The score is given with a factor x100 and the delta gain with DistilCamemBERT-NER used in reference is in parantheses. For the mean inference time measure, an AMD Ryzen 5 4500U @ 2.3GHz with 6 cores was used:
40
 
41
+ | **model** | **time (ms)** | **PER** | **LOC** | **ORG** | **MISC** | **O** |
42
+ | :---------------------------------------------------------------------------------------------------------------: | :----------------: | :--------------: | :--------------: | :--------------: | :--------------: | :------------- : |
43
+ | [cmarkea/distilcamembert-base-ner](https://huggingface.co/cmarkea/distilcamembert-base-ner) | **43.44** | **93.91** | **88.26** | **84.03** | **82.74** | **91.45** |
44
+ | [Jean-Baptiste/camembert-ner](https://huggingface.co/Jean-Baptiste/camembert-ner) | 83.70<br/>(+93%) | 95.20<br/>(+1%) | 90.85<br/>(+3%) | 89.50<br/>(+6%) | 89.02<br/>(+8%) | 92.86<br/>(+2%) |
45
+ | [Davlan/bert-base-multilingual-cased-ner-hrl](https://huggingface.co/Davlan/bert-base-multilingual-cased-ner-hrl) | 87.56<br/>(+102%) | 79.93<br/>(-15%) | 70.39<br/>(-22%) | 60.26<br/>(-28%) | n/a<br/>(n/a%) | 69.95<br/>(-24%) |
46
+ | [flair/ner-french](https://huggingface.co/flair/ner-french) | 314.96<br/>(+625%) | 80.18<br/>(-15%) | 72.11<br/>(-18%) | 67.29<br/>(-20%) | 72.39<br/>(-17%) | 74.34<br/>(-19%) |
47
 
48
  How to use DistilCamemBERT-NER
49
  ------------------------------