valerielucro
/

mistral_gsm8k_dpo_cot_beta_0.3

Inference Endpoints

Model card Files Files and versions Community

mistral_gsm8k_dpo_cot_beta_0.3

Commit History

rank 8 adapter trained with DPO on the gsm8k preference dataset with cot and 1 epoch

ad75933
verified

valerielucro commited on Jun 22

rank 8 adapter trained with DPO on the gsm8k preference dataset with cot and 1 epoch

cfa8af0
verified

valerielucro commited on Jun 22

initial commit

45e2b63
verified

valerielucro commited on Jun 22