satyamt commited on
Commit
8880429
1 Parent(s): 2de6d66

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -0
README.md CHANGED
@@ -17,6 +17,23 @@ Mediquad-20B is a Mixure of Experts (MoE) made with the following models:
17
  * [allenai/tulu-2-dpo-7b](https://huggingface.co/allenai/tulu-2-dpo-7b)
18
  * [microsoft/Orca-2-7b](https://huggingface.co/microsoft/Orca-2-7b)
19
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20
  ## 🧩 Configuration
21
 
22
  ```yamlbase_model: allenai/tulu-2-dpo-7b
 
17
  * [allenai/tulu-2-dpo-7b](https://huggingface.co/allenai/tulu-2-dpo-7b)
18
  * [microsoft/Orca-2-7b](https://huggingface.co/microsoft/Orca-2-7b)
19
 
20
+ ## Evaluations
21
+
22
+ | Benchmark | Mediquad-20B | meditron-7b | Orca-2-7b | meditron-70b |
23
+ | --- | --- | --- | --- | --- |
24
+ | MedMCQA | | | | |
25
+ | ClosedPubMedQA | | | | |
26
+ | PubMedQA | | | | |
27
+ | MedQA | | | | |
28
+ | MedQA4 | | | | |
29
+ | MedicationQA | | | | |
30
+ | MMLU Medical | | | | |
31
+ | TruthfulQA | | | | |
32
+ | GSM8K | | | | |
33
+ | ARC | | | | |
34
+ | HellaSwag | | | | |
35
+ | Winogrande | | | | |
36
+
37
  ## 🧩 Configuration
38
 
39
  ```yamlbase_model: allenai/tulu-2-dpo-7b