llama2_7b_DPO_lima_rand_sel_50_preference / adapter_model.safetensors

Commit History

Upload model
fa9ad9b
verified

dinaaaaaa commited on