karan4d commited on
Commit
9241f12
1 Parent(s): c952ecb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -20,7 +20,7 @@ This model was trained with a WizardCoder base, which itself uses a StarCoder ba
20
 
21
  The model is truly great at code, but, it does come with a tradeoff though. While far better at code than the original Nous-Hermes built on Llama, it is worse than WizardCoder at pure code benchmarks, like HumanEval.
22
 
23
- It comes in at 39% on HumanEval, with WizardCoder at 57%. This is somewhat dissapointing to us, and we are exploring why now.
24
 
25
  However, it does seem better at non-code than WizardCoder on a variety of things, including writing tasks.
26
 
 
20
 
21
  The model is truly great at code, but, it does come with a tradeoff though. While far better at code than the original Nous-Hermes built on Llama, it is worse than WizardCoder at pure code benchmarks, like HumanEval.
22
 
23
+ It comes in at 39% on HumanEval, with WizardCoder at 57%. This is a preliminary experiment, and we are exploring improvements now.
24
 
25
  However, it does seem better at non-code than WizardCoder on a variety of things, including writing tasks.
26