Model: twinkle-ai/Llama-3.2-3B-F1-Reasoning-Instruct
Author: twinkle-ai
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, llama, text-generation, Taiwan, R.O.C, zhtw, SLM, Llama-32, conversational, en, zh, dataset:lianghsun/tw-reasoning-instruct, dataset:minyichen/tw-instruct-R1-200k, dataset:minyichen/tw_mm_R1, base_model:lianghsun/Llama-3.2-3B-F1-Base, base_model:finetune:lianghsun/Llama-3.2-3B-F1-Base, license:llama3.2, model-index, text-generation-inference, endpoints_compatible, region:us
Base models (finetune): id: lianghsun/Llama-3.2-3B-F1-Base
Card metadata: license: llama3.2
language: en, zh
base_model: meta-llama/Llama-3.2-3B, lianghsun/Llama-3.2-3B-F1-Base
library_name: transformers
tags: Taiwan, R.O.C, zhtw, SLM, Llama-32
datasets: lianghsun/tw-reasoning-instruct, minyichen/tw-instruct-R1-200k, minyichen/tw_mm_R1
model-index: name: Llama-3.2-3B-F1-Reasoning-Instruct
results: task: type: question-answering
name: Single Choice Question
dataset: type: ikala/tmmluplus
name: tmmlu+
config: all
split: test
revision: c0e8ae955997300d5dbf0e382bf0ba5115f85e8c
metrics: name: single choice
type: accuracy
value: 46.16
verified: no, task: type: question-answering
name: Single Choice Question
dataset: type: cais/mmlu
name: mmlu
config: all
split: test
revision: c30699e
metrics: name: single choice
type: accuracy
value: 51.22
verified: no, task: type: question-answering
name: Single Choice Question
dataset: type: lianghsun/tw-legal-benchmark-v1
name: tw-legal-benchmark-v1
config: all
split: test
revision: 66c3a5f
metrics: name: single choice
type: accuracy
value: 34.92
verified: no
metrics: accuracy
Likes: 46 | All-time downloads: 696
Created: 2025-03-31 06:12:20