Model: Lucy-in-the-Sky/Mistral-Small-24B-Instruct-2501-reasoning-Q8_0-GGUF
Author: Lucy-in-the-Sky
Pipeline: text-generation
Tags: gguf, reasoning, llama-cpp, gguf-my-repo, text-generation, en, dataset:open-r1/OpenR1-Math-220k, dataset:yentinglin/s1K-1.1-trl-format, dataset:simplescaling/s1K-1.1, base_model:yentinglin/Mistral-Small-24B-Instruct-2501-reasoning, base_model:quantized:yentinglin/Mistral-Small-24B-Instruct-2501-reasoning, license:apache-2.0, model-index, endpoints_compatible, region:us, conversational
Base models (quantized): id: yentinglin/Mistral-Small-24B-Instruct-2501-reasoning
Card metadata: license: apache-2.0
datasets: open-r1/OpenR1-Math-220k, yentinglin/s1K-1.1-trl-format, simplescaling/s1K-1.1
language: en
metrics: accuracy
base_model: yentinglin/Mistral-Small-24B-Instruct-2501-reasoning
pipeline_tag: text-generation
tags: reasoning, llama-cpp, gguf-my-repo
model-index: name: yentinglin/Mistral-Small-24B-Instruct-2501-reasoning
results: task: type: text-generation
dataset: name: MATH-500
type: MATH
metrics: type: pass@1
value: 0.95
name: pass@1
verified: no
source: url: https://huggingface.co/spaces/yentinglin/zhtw-reasoning-eval-leaderboard
name: yentinglin/zhtw-reasoning-eval-leaderboard, task: type: text-generation
dataset: name: AIME 2025
type: AIME
metrics: type: pass@1
value: 0.5333
name: pass@1
verified: no, type: pass@1
value: 0.6667
name: pass@1
verified: no
source: url: https://huggingface.co/spaces/yentinglin/zhtw-reasoning-eval-leaderboard
name: yentinglin/zhtw-reasoning-eval-leaderboard, task: type: text-generation
dataset: name: GPQA Diamond
type: GPQA
metrics: type: pass@1
value: 0.62022
name: pass@1
verified: no
source: url: https://huggingface.co/spaces/yentinglin/zhtw-reasoning-eval-leaderboard
name: yentinglin/zhtw-reasoning-eval-leaderboard
Likes: 0 | All-time downloads: 89
Created: 2025-02-17 14:25:36