File size: 1,138 Bytes
2b23fa5
 
d26f2de
23eb765
b820727
d26f2de
 
eec31da
0ff2cce
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
---
license: apache-2.0
---
**OpenHermes-7B-Symbolic**
<img src="https://i.ibb.co/zJJyywL/DALL-E-2023-12-10-22-19-40-A-digital-art-piece-that-creatively-represents-the-famous-Thinking-Man-st.png" width="45%" height="auto">

## Model description
OpenHermes-7B-Symbolic is a OpenHermes-2.5-Mistral-7B fine-tuned on 93K comprehensive and meticulously curated samples. 
Each sample was structured to facilitate the model's understanding and generation of complex, hierarchical ICD medical coding system. 

## Performance
| Benchmark   | OpenHermes-7B-Symbolic | OpenHermes-2.5-Mistral-7B |
|-------------|------------------------|---------------------------|
| Average     | 64.44                  | 62.92                     |
| ARC         | 63.14                  | 64.93                     |
| HellaSwag   | 82.73                  | 84.18                     |
| MMLU        | 62.62                  | 63.64                     |
| TruthfulQA  | 48.82                  | 52.24                     |
| Winogrande  | 75.85                  | 78.06                     |
| GSM8K       | 53.45                  | 26.08                     |