Columbia-NLP
/

gemma-2b-zephyr-dpo

Text Generation

alignment-handbook

Generated from Trainer

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

qywu commited on Apr 12

Commit

b9331f7

•

1 Parent(s): e5f12d3

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -97,7 +97,7 @@ model-index:
       name: accuracy
 ---
-# Model Card for Gemma 2B Zephyr SFT
 We trained the [google/gemma-2b](https://huggingface.co/google/gemma-2b) with DPO and data from `argilla/dpo-mix-7k`.
 We carefully selected the hyper-parameters to achieve the best DPO performance.

       name: accuracy
 ---
+# Model Card for Gemma 2B Zephyr DPO
 We trained the [google/gemma-2b](https://huggingface.co/google/gemma-2b) with DPO and data from `argilla/dpo-mix-7k`.
 We carefully selected the hyper-parameters to achieve the best DPO performance.