adaptor with DPO onfull gsm8k preference dataset and 1 epoch

d00bd08

verified

valerielucro commited on Jul 21