hamishivi commited on
Commit
ce954b4
β€’
1 Parent(s): afa5549

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -21
README.md CHANGED
@@ -37,27 +37,13 @@ For more details, read the paper: [Camels in a Changing Climate: Enhancing LM Ad
37
 
38
  | Model | Size | Alignment | MT-Bench (score) | AlpacaEval (win rate %) |
39
  |-------------|-----|----|---------------|--------------|
40
- | **Tulu-v2-7b** πŸͺ | **7B** | **dDPO** | **6.30** | **73.9** |
41
- | **Tulu-v2-dpo-7b** πŸͺ | **7B** | **dDPO** | **6.29** | **85.1** |
42
- | StableLM-Tuned-Ξ± | 7B| dSFT |2.75| -|
43
- | MPT-Chat | 7B |dSFT |5.42| -|
44
- | Xwin-LMv0.1 | 7B| dPPO| 6.19| 87.83|
45
- | Mistral-Instructv0.1 | 7B| - | 6.84 |-|
46
- | Zephyr-7b-Ξ± |7B| dDPO| 6.88| -|
47
- | Zephyr-7b-Ξ² πŸͺ | 7B | dDPO | 7.34 | 90.60 |
48
- | **Tulu-v2-13b** πŸͺ | **13B** | **dDPO** | **6.70** | **78.9** |
49
- | **Tulu-v2-dpo-13b** πŸͺ | **13B** | **dDPO** | **7.00** | **89.5** |
50
- | Falcon-Instruct | 40B |dSFT |5.17 |45.71|
51
- | Guanaco | 65B | SFT |6.41| 71.80|
52
- | Llama2-Chat | 70B |RLHF |6.86| 92.66|
53
- | Vicuna v1.3 | 33B |dSFT |7.12 |88.99|
54
- | WizardLM v1.0 | 70B |dSFT |7.71 |-|
55
- | Xwin-LM v0.1 | 70B |dPPO |- |95.57|
56
- | **Tulu-v2-70b** πŸͺ | **70B** | **dDPO** | **7.49** | **86.6** |
57
- | **Tulu-v2-dpo-70b** πŸͺ | **70B** | **dDPO** | **7.89** | **95.1** |
58
- | GPT-3.5-turbo | - |RLHF |7.94 |89.37|
59
- | Claude 2 | - |RLHF |8.06| 91.36|
60
- | GPT-4 | -| RLHF |8.99| 95.28|
61
 
62
  ## Input Format
63
 
 
37
 
38
  | Model | Size | Alignment | MT-Bench (score) | AlpacaEval (win rate %) |
39
  |-------------|-----|----|---------------|--------------|
40
+ | **Tulu-v2-7b** πŸͺ | **7B** | **SFT** | **6.30** | **73.9** |
41
+ | **Tulu-v2-dpo-7b** πŸͺ | **7B** | **DPO** | **6.29** | **85.1** |
42
+ | **Tulu-v2-13b** πŸͺ | **13B** | **SFT** | **6.70** | **78.9** |
43
+ | **Tulu-v2-dpo-13b** πŸͺ | **13B** | **DPO** | **7.00** | **89.5** |
44
+ | **Tulu-v2-70b** πŸͺ | **70B** | **SFT** | **7.49** | **86.6** |
45
+ | **Tulu-v2-dpo-70b** πŸͺ | **70B** | **DPO** | **7.89** | **95.1** |
46
+
 
 
 
 
 
 
 
 
 
 
 
 
 
 
47
 
48
  ## Input Format
49