valerielucro
/

mistral_gsm8k_dpo_cot_beta_0.8

Inference Endpoints

Model card Files Files and versions Community

mistral_gsm8k_dpo_cot_beta_0.8 / tokenizer.model

Commit History

adapter trained with DPO on the gsm8k preference dataset with cot and 1 epoch

9c07365
verified

valerielucro commited on Jun 26