Update README.md

README.md

@@ -43,7 +43,7 @@ The following hyperparameters were used during training:
 
 ### Performance
 
-hf (pretrained=mistralai/Mistral-7B-v0.1,parallelize=True,load_in_4bit=True,peft=chenhugging/mistral-7b-medqa-v1), limit: 100.0, num_fewshot: None
+hf (pretrained=mistralai/Mistral-7B-v0.1,parallelize=True,load_in_4bit=True,peft=chenhugging/mistral-7b-medqa-v1), gen_kwargs: (None), limit: 100.0, num_fewshot: None
 
 |        Tasks        |Version|Filter|n-shot| Metric |Value|   |Stderr|
 |---------------------|-------|------|-----:|--------|----:|---|-----:|
@@ -54,3 +54,17 @@ hf (pretrained=mistralai/Mistral-7B-v0.1,parallelize=True,load_in_4bit=True,peft
 |clinical_knowledge   |      0|none  |     0|acc     | 0.63|±  |0.0485|
 |medmcqa              |Yaml   |none  |     0|acc     | 0.41|±  |0.0494|
 |aocnp                |Yaml   |none  |     0|acc     | 0.61|±  |0.0490|
+
+
+### Appendix (original performance before lora-finetune)
+
+hf (pretrained=mistralai/Mistral-7B-v0.1,parallelize=True,load_in_4bit=True), gen_kwargs: (None), limit: 100.0, num_fewshot: None, batch_size: 1
+|        Tasks        |Version|Filter|n-shot| Metric |Value|   |Stderr|
+|---------------------|-------|------|-----:|--------|----:|---|-----:|
+|pubmedqa             |      1|none  |     0|acc     | 0.98|±  |0.0141|
+|ocn                  |Yaml   |none  |     0|acc     | 0.62|±  |0.0488|
+|professional_medicine|      0|none  |     0|acc     | 0.64|±  |0.0482|
+|college_medicine     |      0|none  |     0|acc     | 0.65|±  |0.0479|
+|clinical_knowledge   |      0|none  |     0|acc     | 0.68|±  |0.0469|
+|medmcqa              |Yaml   |none  |     0|acc     | 0.45|±  |0.0500|
+|aocnp                |Yaml   |none  |     0|acc     | 0.47|±  |0.0502|