Update README.md

README.md

@@ -41,7 +41,7 @@ The following hyperparameters were used during training:
 
 ### Perfromance
 
-hf (pretrained=mistralai/Mistral-7B-v0.1,parallelize=True,load_in_4bit=True,peft=chenhugging/mistral-7b-medwiki-v1), limit: 100.0, num_fewshot: None
+hf (pretrained=mistralai/Mistral-7B-v0.1,parallelize=True,load_in_4bit=True,peft=chenhugging/mistral-7b-medwiki-v1), gen_kwargs: (None), limit: 100.0, num_fewshot: None
 |        Tasks        |Version|Filter|n-shot| Metric |Value|   |Stderr|
 |---------------------|-------|------|-----:|--------|----:|---|-----:|
 |pubmedqa             |      1|none  |     0|acc     | 0.99|±  |0.0100|
@@ -51,3 +51,17 @@ hf (pretrained=mistralai/Mistral-7B-v0.1,parallelize=True,load_in_4bit=True,peft
 |medmcqa              |Yaml   |none  |     0|acc     | 0.40|±  |0.0492|
 |ocn                  |Yaml   |none  |     0|acc     | 0.61|±  |0.0490|
 |aocnp                |Yaml   |none  |     0|acc     | 0.52|±  |0.0502|
+
+
+### Appendix (original performance before lora-finetune)
+
+hf (pretrained=mistralai/Mistral-7B-v0.1,parallelize=True,load_in_4bit=True), gen_kwargs: (None), limit: 100.0, num_fewshot: None, batch_size: 1
+|        Tasks        |Version|Filter|n-shot| Metric |Value|   |Stderr|
+|---------------------|-------|------|-----:|--------|----:|---|-----:|
+|pubmedqa             |      1|none  |     0|acc     | 0.98|±  |0.0141|
+|professional_medicine|      0|none  |     0|acc     | 0.64|±  |0.0482|
+|college_medicine     |      0|none  |     0|acc     | 0.65|±  |0.0479|
+|clinical_knowledge   |      0|none  |     0|acc     | 0.68|±  |0.0469|
+|medmcqa              |Yaml   |none  |     0|acc     | 0.45|±  |0.0500|
+|ocn                  |Yaml   |none  |     0|acc     | 0.62|±  |0.0488|
+|aocnp                |Yaml   |none  |     0|acc     | 0.47|±  |0.0502|