Update README.md
Browse files
README.md
CHANGED
@@ -6,18 +6,18 @@ language:
|
|
6 |
- en
|
7 |
metrics:
|
8 |
- type: f1
|
9 |
-
value: 0.
|
10 |
name: micro F1
|
11 |
args:
|
12 |
-
threshold: 0.
|
13 |
- type: NDCG@3
|
14 |
-
value: 0.
|
15 |
name: NDCG@5
|
16 |
- type: NDCG@5
|
17 |
-
value: 0.
|
18 |
name: NDCG@5
|
19 |
- type: NDCG@10
|
20 |
-
value: 0.
|
21 |
name: NDCG@10
|
22 |
tags:
|
23 |
- eurovoc
|
@@ -53,14 +53,17 @@ model = EurovocTagger.from_pretrained("EuropeanParliament/eurovoc_eu")
|
|
53 |
## Metrics
|
54 |
|
55 |
|
56 |
-
###
|
57 |
|
58 |
-
|
59 |
-
|
60 |
-
|
61 |
-
|
|
62 |
-
|
63 |
-
|
|
|
|
|
|
|
|
64 |
|
65 |
These values are in line with the state of the art in the field, see the publication [Large Scale Legal Text Classification Using Transformer Models](https://arxiv.org/pdf/2010.12871.pdf).
|
66 |
|
|
|
6 |
- en
|
7 |
metrics:
|
8 |
- type: f1
|
9 |
+
value: 0.8188
|
10 |
name: micro F1
|
11 |
args:
|
12 |
+
threshold: 0.41
|
13 |
- type: NDCG@3
|
14 |
+
value: 0.8778
|
15 |
name: NDCG@5
|
16 |
- type: NDCG@5
|
17 |
+
value: 0.8625
|
18 |
name: NDCG@5
|
19 |
- type: NDCG@10
|
20 |
+
value: 0.8711
|
21 |
name: NDCG@10
|
22 |
tags:
|
23 |
- eurovoc
|
|
|
53 |
## Metrics
|
54 |
|
55 |
|
56 |
+
### Eurovoc Dataset version 23.08
|
57 |
|
58 |
+
Stratification ratio 90/10 for training/test and training/validation
|
59 |
+
|
60 |
+
|
61 |
+
| Metric | Value | Threshold Value |
|
62 |
+
|------------|------------|-----------------|
|
63 |
+
| Micro F1 | 0.8188 | 0.41 |
|
64 |
+
| NDCG@3 | 0.8778 | - |
|
65 |
+
| NDCG@5 | 0.8625 | - |
|
66 |
+
| NDCG@10 | 0.8711 | - |
|
67 |
|
68 |
These values are in line with the state of the art in the field, see the publication [Large Scale Legal Text Classification Using Transformer Models](https://arxiv.org/pdf/2010.12871.pdf).
|
69 |
|