Model: tianyil1/MistralForCausalLM_Cal_DPO
Author: tianyil1
Tags: safetensors, mistral, alignment_handbook-handbook, generated_from_trainer, dataset:HuggingFaceH4/ultrafeedback_binarized, arxiv:2311.07911, arxiv:2210.09261, arxiv:2311.12022, arxiv:2310.16049, arxiv:2406.01574, base_model:alignment-handbook/zephyr-7b-sft-full, base_model:finetune:alignment-handbook/zephyr-7b-sft-full, license:apache-2.0, model-index, region:us
Base models (finetune): id: alignment-handbook/zephyr-7b-sft-full
Card metadata: license: apache-2.0
base_model: alignment-handbook/zephyr-7b-sft-full
tags: alignment_handbook-handbook, generated_from_trainer
datasets: HuggingFaceH4/ultrafeedback_binarized
model-index: name: mistral-7B-DPO
results: task: type: text-generation
dataset: name: IFEval
type: IFEval
metrics: name: inst_level_strict_acc
type: IFEval
value: 53.06
verified: no
source: name: Open LLM Leaderboard
url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard, task: type: text-generation
dataset: name: BBH
type: BBH
metrics: name: acc_norm
type: Big Bench Hard (BBH)
value: 21.78
verified: no
source: name: Open LLM Leaderboard
url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard, task: type: text-generation
dataset: name: MATH
type: MATH
metrics: name: exact_match
type: Math Challenges
value: 2.87
verified: no
source: name: Open LLM Leaderboard
url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard, task: type: text-generation
dataset: name: GPQA
type: GPQA
metrics: name: acc_norm
type: Generalized Purpose Question Answering (GPQA)
value: 3.47
verified: no
source: name: Open LLM Leaderboard
url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard, task: type: text-generation
dataset: name: MuSR
type: MuSR
metrics: name: acc_norm
type: MuSR
value: 7.54
verified: no
source: name: Open LLM Leaderboard
url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard, task: type: text-generation
dataset: name: MMLU-PRO
type: MMLU-PRO
metrics: name: acc
type: MMLU-PRO
value: 19.59
verified: no
source: name: Open LLM Leaderboard
url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard
Likes: 1 | All-time downloads: 114
Created: 2025-01-25 03:20:02