1.1
Browse files
README.md
CHANGED
@@ -6,18 +6,18 @@ language:
|
|
6 |
- en
|
7 |
metrics:
|
8 |
- type: f1
|
9 |
-
value: 0.
|
10 |
name: micro F1
|
11 |
args:
|
12 |
-
threshold: 0.
|
13 |
- type: NDCG@3
|
14 |
-
value: 0.
|
15 |
name: NDCG@5
|
16 |
- type: NDCG@5
|
17 |
-
value: 0.
|
18 |
name: NDCG@5
|
19 |
- type: NDCG@10
|
20 |
-
value: 0.
|
21 |
name: NDCG@10
|
22 |
tags:
|
23 |
- eurovoc
|
@@ -105,7 +105,7 @@ This classification model is built on top of [EUBERT](https://huggingface.co/Eur
|
|
105 |
With less than 100 million parameters, it can be deployed on commodity hardware without GPU acceleration (around 200 ms per inference for 2000 characters).
|
106 |
|
107 |
Parameters :
|
108 |
-
- Number of epochs
|
109 |
- Batch size 10
|
110 |
- Max lenght 512
|
111 |
- Learning Rate 5e-05
|
@@ -126,10 +126,10 @@ On Eurovoc Dataset version 23.08 with a stratification ratio 90/10 for training/
|
|
126 |
|
127 |
| Metric | Value | Threshold Value |
|
128 |
|------------|------------|-----------------|
|
129 |
-
| Micro F1 | 0.
|
130 |
-
| NDCG@3 | 0.
|
131 |
-
| NDCG@5 | 0.
|
132 |
-
| NDCG@10 | 0.
|
133 |
|
134 |
These values are higher than the state of the art previously known in the field, see publications:
|
135 |
|
|
|
6 |
- en
|
7 |
metrics:
|
8 |
- type: f1
|
9 |
+
value: 0.8345
|
10 |
name: micro F1
|
11 |
args:
|
12 |
+
threshold: 0.46
|
13 |
- type: NDCG@3
|
14 |
+
value: 0.8819
|
15 |
name: NDCG@5
|
16 |
- type: NDCG@5
|
17 |
+
value: 0.8689
|
18 |
name: NDCG@5
|
19 |
- type: NDCG@10
|
20 |
+
value: 0.8780
|
21 |
name: NDCG@10
|
22 |
tags:
|
23 |
- eurovoc
|
|
|
105 |
With less than 100 million parameters, it can be deployed on commodity hardware without GPU acceleration (around 200 ms per inference for 2000 characters).
|
106 |
|
107 |
Parameters :
|
108 |
+
- Number of epochs 16
|
109 |
- Batch size 10
|
110 |
- Max lenght 512
|
111 |
- Learning Rate 5e-05
|
|
|
126 |
|
127 |
| Metric | Value | Threshold Value |
|
128 |
|------------|------------|-----------------|
|
129 |
+
| Micro F1 | 0.8345 | 0.46 |
|
130 |
+
| NDCG@3 | 0.8819 | - |
|
131 |
+
| NDCG@5 | 0.8689 | - |
|
132 |
+
| NDCG@10 | 0.8780 | - |
|
133 |
|
134 |
These values are higher than the state of the art previously known in the field, see publications:
|
135 |
|