ArkaAbacus commited on
Commit
0a4f0a2
1 Parent(s): 9540b64

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -34,22 +34,22 @@ This model was built using the Smaug recipe for improving performance on real w
34
  score
35
  model turn
36
  Llama-3-Smaug-8B 1 8.77500
37
- Meta-Llama-3-8B-Instruct 1 8.1
38
  ########## Second turn ##########
39
  score
40
  model turn
41
- Meta-Llama-3-8B-Instruct 2 8.2125
42
  Llama-3-Smaug-8B 2 7.8875
43
  ########## Average ##########
44
  score
45
  model
46
  Llama-3-Smaug-8B 8.331250
47
- Meta-Llama-3-8B-Instruct 8.15625
48
  ```
49
 
50
  | Model | First turn | Second Turn | Average |
51
  | :---- | ---------: | ----------: | ------: |
52
  | Llama-3-Smaug-8B | 8.78 | 7.89 | 8.33 |
53
- | Llama-3-8B-Instruct | 8.31250 | 7.8875 | 8.10 |
54
 
55
  This version of Smaug uses new techniques and new data compared to [Smaug-72B](https://huggingface.co/abacusai/Smaug-72B-v0.1), and more information will be released later on. For now, see the previous Smaug paper: https://arxiv.org/abs/2402.13228.
 
34
  score
35
  model turn
36
  Llama-3-Smaug-8B 1 8.77500
37
+ Meta-Llama-3-8B-Instruct 1 8.31250
38
  ########## Second turn ##########
39
  score
40
  model turn
41
+ Meta-Llama-3-8B-Instruct 2 7.8875
42
  Llama-3-Smaug-8B 2 7.8875
43
  ########## Average ##########
44
  score
45
  model
46
  Llama-3-Smaug-8B 8.331250
47
+ Meta-Llama-3-8B-Instruct 8.10
48
  ```
49
 
50
  | Model | First turn | Second Turn | Average |
51
  | :---- | ---------: | ----------: | ------: |
52
  | Llama-3-Smaug-8B | 8.78 | 7.89 | 8.33 |
53
+ | Llama-3-8B-Instruct | 8.31 | 7.89 | 8.10 |
54
 
55
  This version of Smaug uses new techniques and new data compared to [Smaug-72B](https://huggingface.co/abacusai/Smaug-72B-v0.1), and more information will be released later on. For now, see the previous Smaug paper: https://arxiv.org/abs/2402.13228.