Hugging Face model: jiazhengli/Mixtral-8x7B-Instruct-v0.1-QLoRA-Assessment-Rationale-dpo
Author: jiazhengli
Created: 2024-07-06 21:56:11
Last modified: 2024-10-14 11:30:10
Library: peft
Likes: 0 | Downloads: 2
Tags: peft, safetensors, llama-factory, lora, generated_from_trainer, en, dataset:jiazhengli/Rationale_MCTS, dataset:jiazhengli/Synthetic_Rationale, arxiv:2406.19949, base_model:jiazhengli/Mixtral-8x7B-Instruct-v0.1-QLoRA-Assessment-Rationale-sft, base_model:adapter:jiazhengli/Mixtral-8x7B-Instruct-v0.1-QLoRA-Assessment-Rationale-sft, license:other, region:us
Base model relation: adapter
Base models: id: jiazhengli/Mixtral-8x7B-Instruct-v0.1-QLoRA-Assessment-Rationale-sft
Card metadata:
license: other
library_name: peft
tags: llama-factory, lora, generated_from_trainer
base_model: jiazhengli/Mixtral-8x7B-Instruct-v0.1-QLoRA-Assessment-Rationale-sft, mistralai/Mixtral-8x7B-Instruct-v0.1
datasets: jiazhengli/Rationale_MCTS, jiazhengli/Synthetic_Rationale
language: en
metrics: accuracy, f1