Commit
•
97c31f1
1
Parent(s):
c3024c1
Update README.md
Browse files
README.md
CHANGED
@@ -68,8 +68,7 @@ Balanced accuracy metrics on all datasets.
|
|
68 |
`deberta-v3-large-zeroshot-v1.1-all-33` was trained on all datasets, with only maximum 500 texts per class to avoid overfitting.
|
69 |
The metrics on these datasets are therefore not strictly zeroshot, as the model has seen some data for each task.
|
70 |
`deberta-v3-large-zeroshot-v1.1-heldout` indicates zeroshot performance on the respective dataset.
|
71 |
-
To calculate these zeroshot metrics,
|
72 |
-
The other setup (hyperparameters etc.) remained the same.
|
73 |
|
74 |
![figure_large_v1.1](https://github.com/MoritzLaurer/zeroshot-classifier/blob/main/results/fig_large_v1.1.png)
|
75 |
|
|
|
68 |
`deberta-v3-large-zeroshot-v1.1-all-33` was trained on all datasets, with only maximum 500 texts per class to avoid overfitting.
|
69 |
The metrics on these datasets are therefore not strictly zeroshot, as the model has seen some data for each task.
|
70 |
`deberta-v3-large-zeroshot-v1.1-heldout` indicates zeroshot performance on the respective dataset.
|
71 |
+
To calculate these zeroshot metrics, the pipeline was run 28 times, each time with one dataset held out from training to simulate a zeroshot setup.
|
|
|
72 |
|
73 |
![figure_large_v1.1](https://github.com/MoritzLaurer/zeroshot-classifier/blob/main/results/fig_large_v1.1.png)
|
74 |
|