Update README.md
Browse files
README.md
CHANGED
|
@@ -76,6 +76,28 @@ My name is Samantha.
|
|
| 76 |
| 2 | togethercomputer/LLaMA-2-7B-32K-Instruct | 50.02 | 51.11 | 78.51 | 46.11 | 44.86 | 73.88 | 5.69 |
|
| 77 |
| 3 | togethercomputer/LLaMA-2-7B-32K | 47.07 | 47.53 | 76.14 | 43.33 | 39.23 | 71.9 | 4.32 |
|
| 78 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 79 |
## Evaluation by GPT-4 across 25 random prompts from ChatDoctor-200k Dataset
|
| 80 |
|
| 81 |
### Overall Rating: 83.5/100
|
|
|
|
| 76 |
| 2 | togethercomputer/LLaMA-2-7B-32K-Instruct | 50.02 | 51.11 | 78.51 | 46.11 | 44.86 | 73.88 | 5.69 |
|
| 77 |
| 3 | togethercomputer/LLaMA-2-7B-32K | 47.07 | 47.53 | 76.14 | 43.33 | 39.23 | 71.9 | 4.32 |
|
| 78 |
|
| 79 |
+
|
| 80 |
+
## Subject-wise Accuracy
|
| 81 |
+
|
| 82 |
+
| Subject | Accuracy (%) |
|
| 83 |
+
|-----------------------|--------------|
|
| 84 |
+
| Clinical Knowledge | 52.83 |
|
| 85 |
+
| Medical Genetics | 49.00 |
|
| 86 |
+
| Human Aging | 58.29 |
|
| 87 |
+
| Human Sexuality | 55.73 |
|
| 88 |
+
| College Medicine | 38.73 |
|
| 89 |
+
| Anatomy | 41.48 |
|
| 90 |
+
| College Biology | 52.08 |
|
| 91 |
+
| College Medicine | 38.73 |
|
| 92 |
+
| High School Biology | 53.23 |
|
| 93 |
+
| Professional Medicine | 38.73 |
|
| 94 |
+
| Nutrition | 50.33 |
|
| 95 |
+
| Professional Psychology | 46.57 |
|
| 96 |
+
| Virology | 41.57 |
|
| 97 |
+
| High School Psychology | 66.60 |
|
| 98 |
+
| Average | 48.85% |
|
| 99 |
+
|
| 100 |
+
|
| 101 |
## Evaluation by GPT-4 across 25 random prompts from ChatDoctor-200k Dataset
|
| 102 |
|
| 103 |
### Overall Rating: 83.5/100
|