Update README.md
Browse files
README.md
CHANGED
@@ -40,7 +40,7 @@ Evaluation results
|
|
40 |
Benchmark
|
41 |
---------
|
42 |
|
43 |
-
We compare the [DistilCamemBERT](https://huggingface.co/cmarkea/distilcamembert-base) model
|
44 |
|
45 |
| **model** | **time (ms)** | **accuracy (%)** | **MCC (x100)** |
|
46 |
| :--------------: | :-----------: | :--------------: | :------------: |
|
|
|
40 |
Benchmark
|
41 |
---------
|
42 |
|
43 |
+
We compare the [DistilCamemBERT](https://huggingface.co/cmarkea/distilcamembert-base) model to 2 other modelizations working on french language. The first one [BaptisteDoyen/camembert-base-xnli](https://huggingface.co/BaptisteDoyen/camembert-base-xnli) is based on well named [CamemBERT](https://huggingface.co/camembert-base), the french RoBERTa model and the second one [MoritzLaurer/mDeBERTa-v3-base-mnli-xnli](https://huggingface.co/MoritzLaurer/mDeBERTa-v3-base-mnli-xnli) based on [mDeBERTav3](https://huggingface.co/microsoft/mdeberta-v3-base) a multilingual model. To compare the performances the metrics of accuracy and [MCC (Matthews Correlation Coefficient)](https://en.wikipedia.org/wiki/Phi_coefficient) was used and for the mean inference time measure, an **AMD Ryzen 5 4500U @ 2.3GHz with 6 cores** was used:
|
44 |
|
45 |
| **model** | **time (ms)** | **accuracy (%)** | **MCC (x100)** |
|
46 |
| :--------------: | :-----------: | :--------------: | :------------: |
|