valerielucro
/

mistral_gsm8k_preference_dataset_v2_beta_3

Inference Endpoints

Model card Files Files and versions Community

mistral_gsm8k_preference_dataset_v2_beta_3 / tokenizer.json

valerielucro's picture

second iteration Qlora with DPO on full gsm8k preference dataset version 2.1 and 1 epoch and rank 64, beta 0.3

a6e46a4 verified 3 months ago

history contribute delete

No virus

1.8 MB

File too large to display, you can check the raw version instead.