Columbia-NLP
/

gemma-2b-zephyr-dpo

Text Generation

alignment-handbook

Generated from Trainer

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

qywu commited on Apr 12

Commit

e5f12d3

•

1 Parent(s): a6501ce

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -134,5 +134,6 @@ We evaluate our model with `GPT-4-0125-preview` as the judge.
 | google/gemma-2b-it                       | 4.71  | 2.95   | **4.35**       | 6.15       | 2.90 | 3.50      | 5.60     | **5.50** | **6.70**    |
 | wandb/gemma-2b-zephyr-sft                | 4.03  | 3.10   | 3.15       | 5.00       | 2.70 | 2.65      | 5.10     | 4.80 | 5.75    |
 | wandb/gemma-2b-zephyr-dpo                | 4.06  | 2.80   | 2.90       | 5.55       | 2.65 | 2.70      | 5.20     | 4.80 | 5.85    |
 | Columbia-NLP/gemma-2b-zephyr-sft     | 4.34  | 3.10   | 3.70       | 6.25       | 2.65 | 2.70      | 5.55     | 5.25 | 5.50    |
 | **Columbia-NLP/gemma-2b-zephyr-dpo**         | **4.75**  | **3.50**   | 4.05       | **6.75**       | **3.30** | **3.70**      | **5.85**     | 5.40 | 5.53    |

 | google/gemma-2b-it                       | 4.71  | 2.95   | **4.35**       | 6.15       | 2.90 | 3.50      | 5.60     | **5.50** | **6.70**    |
 | wandb/gemma-2b-zephyr-sft                | 4.03  | 3.10   | 3.15       | 5.00       | 2.70 | 2.65      | 5.10     | 4.80 | 5.75    |
 | wandb/gemma-2b-zephyr-dpo                | 4.06  | 2.80   | 2.90       | 5.55       | 2.65 | 2.70      | 5.20     | 4.80 | 5.85    |
+| anakin87_gemma-2b-orpo                | 4.14  | 3.00   | 3.70      | 6.30      | 2.70 | 2.35      | 5.68    | 4.75 | 4.75    |
 | Columbia-NLP/gemma-2b-zephyr-sft     | 4.34  | 3.10   | 3.70       | 6.25       | 2.65 | 2.70      | 5.55     | 5.25 | 5.50    |
 | **Columbia-NLP/gemma-2b-zephyr-dpo**         | **4.75**  | **3.50**   | 4.05       | **6.75**       | **3.30** | **3.70**      | **5.85**     | 5.40 | 5.53    |