Update README.md
Browse files
README.md
CHANGED
@@ -19,38 +19,45 @@ model-index:
|
|
19 |
metrics:
|
20 |
- name: Macro F1
|
21 |
type: f1
|
22 |
-
value: 0.
|
23 |
-
- name:
|
24 |
-
type:
|
25 |
-
value: 0.
|
26 |
-
- name: False
|
27 |
-
type:
|
28 |
-
value: 0.
|
29 |
-
- name: Mixture
|
30 |
-
type:
|
31 |
-
value: 0.
|
32 |
-
- name: True
|
33 |
-
type:
|
34 |
-
value: 0.
|
35 |
-
- name: Unproven
|
36 |
-
type:
|
37 |
-
value: 0.
|
38 |
---
|
39 |
|
40 |
-
|
41 |
-
should probably proofread and complete it, then remove this comment. -->
|
42 |
|
43 |
# bigbird-base-health-fact
|
44 |
|
45 |
This model is a fine-tuned version of [google/bigbird-roberta-base](https://huggingface.co/google/bigbird-roberta-base) on the health_fact dataset.
|
46 |
-
It achieves the following results on the
|
47 |
-
-
|
48 |
-
-
|
49 |
-
-
|
50 |
-
-
|
51 |
-
-
|
52 |
-
-
|
53 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
54 |
|
55 |
The metrics in the eval results on the right-side are for the TEST set. The above results are for the VALIDATION set.
|
56 |
|
|
|
19 |
metrics:
|
20 |
- name: Macro F1
|
21 |
type: f1
|
22 |
+
value: 0.6694031411935434
|
23 |
+
- name: Accuracy
|
24 |
+
type: accuracy
|
25 |
+
value: 0.7948094079480941
|
26 |
+
- name: False Accuracy
|
27 |
+
type: accuracy
|
28 |
+
value: 0.8092783505154639
|
29 |
+
- name: Mixture Accuracy
|
30 |
+
type: accuracy
|
31 |
+
value: 0.4975124378109453
|
32 |
+
- name: True Accuracy
|
33 |
+
type: accuracy
|
34 |
+
value: 0.9148580968280468
|
35 |
+
- name: Unproven Accuracy
|
36 |
+
type: accuracy
|
37 |
+
value: 0.4
|
38 |
---
|
39 |
|
40 |
+
|
|
|
41 |
|
42 |
# bigbird-base-health-fact
|
43 |
|
44 |
This model is a fine-tuned version of [google/bigbird-roberta-base](https://huggingface.co/google/bigbird-roberta-base) on the health_fact dataset.
|
45 |
+
It achieves the following results on the VALIDATION set:
|
46 |
+
- Overall Accuracy: 0.8228995057660626
|
47 |
+
- Macro F1: 0.6979224830442152
|
48 |
+
- False Accuracy: 0.8289473684210527
|
49 |
+
- Mixture Accuracy: 0.47560975609756095
|
50 |
+
- True Accuracy: 0.9332273449920508
|
51 |
+
- Unproven Accuracy: 0.4634146341463415
|
52 |
+
|
53 |
+
It achieves the following results on the TEST set:
|
54 |
+
|
55 |
+
- Overall Accuracy: 0.7948094079480941
|
56 |
+
- Macro F1: 0.6694031411935434
|
57 |
+
- Mixture Accuracy: 0.4975124378109453
|
58 |
+
- False Accuracy: 0.8092783505154639
|
59 |
+
- True Accuracy: 0.9148580968280468
|
60 |
+
- Unproven Accuracy: 0.4
|
61 |
|
62 |
The metrics in the eval results on the right-side are for the TEST set. The above results are for the VALIDATION set.
|
63 |
|