SultanR commited on
Commit
e608484
·
verified ·
1 Parent(s): 8d9d648

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -40,7 +40,7 @@ There's a few reasons on why I like calling this model v0.1:
40
 
41
  I ran these evaluations using [SmolLM2's evaluation code](https://github.com/huggingface/smollm/tree/main/evaluation) for a more fair comparison.
42
 
43
- | Metric | SultanR/SmolTulu-1.7b-it-v0 | SmolLM2-1.7B-Instruct | Llama-1B-Instruct | Qwen2.5-1.5B-Instruct | SmolLM1-1.7B-Instruct |
44
  |:----------------------------|:---------------------:|:---------------------:|:---------------------:|:---------------------:|:---------------------:|
45
  | IFEval (Average prompt/inst) | **67.7** | 56.7 | 53.5 | 47.4 | 23.1 |
46
  | GSM8K (5-shot) | **51.6** | 48.2 | 26.8 | 42.8 | 4.6 |
 
40
 
41
  I ran these evaluations using [SmolLM2's evaluation code](https://github.com/huggingface/smollm/tree/main/evaluation) for a more fair comparison.
42
 
43
+ | Metric | SmolTulu-1.7b-Instruct | SmolLM2-1.7B-Instruct | Llama-1B-Instruct | Qwen2.5-1.5B-Instruct | SmolLM1-1.7B-Instruct |
44
  |:----------------------------|:---------------------:|:---------------------:|:---------------------:|:---------------------:|:---------------------:|
45
  | IFEval (Average prompt/inst) | **67.7** | 56.7 | 53.5 | 47.4 | 23.1 |
46
  | GSM8K (5-shot) | **51.6** | 48.2 | 26.8 | 42.8 | 4.6 |