Model: jiazhengli/Mixtral-8x7B-Instruct-v0.1-QLoRA-Assessment-Rationale-dpo
Author: jiazhengli
Library: peft
Tags: peft, safetensors, llama-factory, lora, generated_from_trainer, en, dataset:jiazhengli/Rationale_MCTS, dataset:jiazhengli/Synthetic_Rationale, arxiv:2406.19949, base_model:jiazhengli/Mixtral-8x7B-Instruct-v0.1-QLoRA-Assessment-Rationale-sft, base_model:adapter:jiazhengli/Mixtral-8x7B-Instruct-v0.1-QLoRA-Assessment-Rationale-sft, license:other, region:us
Base models (adapter): id: jiazhengli/Mixtral-8x7B-Instruct-v0.1-QLoRA-Assessment-Rationale-sft
Card metadata: license: other
library_name: peft
tags: llama-factory, lora, generated_from_trainer
base_model: jiazhengli/Mixtral-8x7B-Instruct-v0.1-QLoRA-Assessment-Rationale-sft, mistralai/Mixtral-8x7B-Instruct-v0.1
model-index: name: sft_trained_woaqa_mixtral_dpo
datasets: jiazhengli/Rationale_MCTS, jiazhengli/Synthetic_Rationale
language: en
metrics: accuracy, f1
Likes: 0 | All-time downloads: 47
Created: 2024-07-06 21:56:11