metadata
license: apache-2.0
OpenHermes-7B-Symbolic
Model description
OpenHermes-7B-Symbolic is a OpenHermes-2.5-Mistral-7B fine-tuned on 93K comprehensive and meticulously curated samples. Each sample was structured to facilitate the model's understanding and generation of complex, hierarchical ICD medical coding system.
Performance
| Benchmark | OpenHermes-7B-Symbolic | OpenHermes-2.5-Mistral-7B |
|---|---|---|
| Average | 64.44 | 62.92 |
| ARC | 63.14 | 64.93 |
| HellaSwag | 82.73 | 84.18 |
| MMLU | 62.62 | 63.64 |
| TruthfulQA | 48.82 | 52.24 |
| Winogrande | 75.85 | 78.06 |
| GSM8K | 53.45 | 26.08 |