teknium commited on
Commit
d4a2212
1 Parent(s): d583c44

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -191,9 +191,14 @@ Average Score Comparison between OpenHermes-1 Llama-2 13B and OpenHermes-2 Mistr
191
  |Average Total | 47.17| 51.42| 52.38| +5.21| +0.96|
192
  ```
193
 
 
 
194
  **HumanEval:**
 
195
  HumanEval: 50.7% @ Pass1
196
 
 
 
197
  # Prompt Format
198
 
199
  OpenHermes 2.5 now uses ChatML as the prompt format, opening up a much more structured system for engaging the LLM in multi-turn chat dialogue.
 
191
  |Average Total | 47.17| 51.42| 52.38| +5.21| +0.96|
192
  ```
193
 
194
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6317aade83d8d2fd903192d9/ADy7p-xIG8qGlC5ZliqpW.png)
195
+
196
  **HumanEval:**
197
+ On code tasks, I first set out to make a hermes-2 coder, but found that it can have generalist improvements to the model, so I settled for slightly less code capabilities, for maximum generalist ones. That said, code capabilities had a decent jump alongside the overall capabilities of the model:
198
  HumanEval: 50.7% @ Pass1
199
 
200
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6317aade83d8d2fd903192d9/IeeZnGmEyK73ejq0fKEms.png)
201
+
202
  # Prompt Format
203
 
204
  OpenHermes 2.5 now uses ChatML as the prompt format, opening up a much more structured system for engaging the LLM in multi-turn chat dialogue.