Commit
•
c2f8f63
1
Parent(s):
9099edd
Update README.md
Browse files
README.md
CHANGED
|
@@ -9,7 +9,7 @@ tags:
|
|
| 9 |
- merge
|
| 10 |
|
| 11 |
---
|
| 12 |
-
#
|
| 13 |
|
| 14 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
| 15 |
|
|
@@ -24,6 +24,12 @@ The following models were included in the merge:
|
|
| 24 |
* [BioMistral/BioMistral-7B](https://huggingface.co/BioMistral/BioMistral-7B)
|
| 25 |
* [HuggingFaceH4/zephyr-7b-beta](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta)
|
| 26 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 27 |
### Configuration
|
| 28 |
|
| 29 |
The following YAML configuration was used to produce this model:
|
|
@@ -31,7 +37,6 @@ The following YAML configuration was used to produce this model:
|
|
| 31 |
```yaml
|
| 32 |
models:
|
| 33 |
- model: mistralai/Mistral-7B-v0.1
|
| 34 |
-
#no parameters necessary for base model
|
| 35 |
- model: HuggingFaceH4/zephyr-7b-beta
|
| 36 |
parameters:
|
| 37 |
density: 0.5
|
|
|
|
| 9 |
- merge
|
| 10 |
|
| 11 |
---
|
| 12 |
+
# BioMistral-merged-zephyr
|
| 13 |
|
| 14 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
| 15 |
|
|
|
|
| 24 |
* [BioMistral/BioMistral-7B](https://huggingface.co/BioMistral/BioMistral-7B)
|
| 25 |
* [HuggingFaceH4/zephyr-7b-beta](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta)
|
| 26 |
|
| 27 |
+
## 🏆 Evaluation
|
| 28 |
+
|
| 29 |
+
|Pubmedqa|Medmcqa|USMLE|arc_challenge|Hellaswag|
|
| 30 |
+
|---|---|---|---|---|
|
| 31 |
+
|76.8|47.21|47.62|55.89|63.43|
|
| 32 |
+
|
| 33 |
### Configuration
|
| 34 |
|
| 35 |
The following YAML configuration was used to produce this model:
|
|
|
|
| 37 |
```yaml
|
| 38 |
models:
|
| 39 |
- model: mistralai/Mistral-7B-v0.1
|
|
|
|
| 40 |
- model: HuggingFaceH4/zephyr-7b-beta
|
| 41 |
parameters:
|
| 42 |
density: 0.5
|