initial adapter with SFT+DPO on gsm8k preference dataset and 1 epoch 129c4f7 verified valerielucro commited on Jul 1