Update README.md
Browse files
README.md
CHANGED
@@ -31,7 +31,7 @@ To correctly load the full model, include the `trust_remote_code=True` argument
|
|
31 |
```python
|
32 |
from transformers import AutoModelForSequenceClassification, AutoTokenizer
|
33 |
|
34 |
-
model = AutoModelForSequenceClassification.from_pretrained("manifesto-project/manifestoberta-xlm-roberta-56policy-topics-context-2023-1", trust_remote_code=True)
|
35 |
tokenizer = AutoTokenizer.from_pretrained("xlm-roberta-large")
|
36 |
|
37 |
sentence = "These principles are under threat."
|
@@ -94,8 +94,8 @@ The model was evaluated on a test set of 199,046 annotated manifesto statements.
|
|
94 |
|
95 |
| | Accuracy | Top2_Acc | Top3_Acc | Precision| Recall | F1_Macro | MCC | Cross-Entropy |
|
96 |
|-------------------------------------------------------------------------------------------------------|:--------:|:--------:|:--------:|:--------:|:------:|:--------:|:---:|:-------------:|
|
97 |
-
[Sentence Model](https://huggingface.co/manifesto-project/xlm-roberta-
|
98 |
-
[Context Model](https://huggingface.co/manifesto-project/xlm-roberta-
|
99 |
|
100 |
### Categories
|
101 |
|
|
|
31 |
```python
|
32 |
from transformers import AutoModelForSequenceClassification, AutoTokenizer
|
33 |
|
34 |
+
model = AutoModelForSequenceClassification.from_pretrained("manifesto-project/manifestoberta-xlm-roberta-56policy-topics-context-2023-1-1", trust_remote_code=True)
|
35 |
tokenizer = AutoTokenizer.from_pretrained("xlm-roberta-large")
|
36 |
|
37 |
sentence = "These principles are under threat."
|
|
|
94 |
|
95 |
| | Accuracy | Top2_Acc | Top3_Acc | Precision| Recall | F1_Macro | MCC | Cross-Entropy |
|
96 |
|-------------------------------------------------------------------------------------------------------|:--------:|:--------:|:--------:|:--------:|:------:|:--------:|:---:|:-------------:|
|
97 |
+
[Sentence Model](https://huggingface.co/manifesto-project/manifestoberta-xlm-roberta-56policy-topics-sentence-2023-1-1)| 0.57 | 0.73 | 0.81 | 0.49 | 0.43 | 0.45 | 0.55| 1.5 |
|
98 |
+
[Context Model](https://huggingface.co/manifesto-project/manifestoberta-xlm-roberta-56policy-topics-context-2023-1-1) | 0.64 | 0.81 | 0.88 | 0.54 | 0.52 | 0.53 | 0.62| 1.15 |
|
99 |
|
100 |
### Categories
|
101 |
|