Model: twinkle-ai/Llama-3.2-3B-F1-Instruct
Author: twinkle-ai
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, llama, text-generation, Taiwan, R.O.C, zhtw, SLM, Llama-32, conversational, en, zh, dataset:lianghsun/tw-reasoning-instruct, dataset:minyichen/tw-instruct-R1-200k, dataset:minyichen/tw_mm_R1, arxiv:2501.13921, base_model:meta-llama/Llama-3.2-3B, base_model:finetune:meta-llama/Llama-3.2-3B, license:llama3.2, model-index, text-generation-inference, endpoints_compatible, region:us
Base models (finetune): id: meta-llama/Llama-3.2-3B
Card metadata: license: llama3.2
language: en, zh
base_model: meta-llama/Llama-3.2-3B
library_name: transformers
tags: Taiwan, R.O.C, zhtw, SLM, Llama-32
datasets: lianghsun/tw-reasoning-instruct, minyichen/tw-instruct-R1-200k, minyichen/tw_mm_R1
model-index: name: Llama-3.2-3B-F1-Instruct
results: task: type: question-answering
name: Single Choice Question
dataset: type: ikala/tmmluplus
name: tmmlu+
config: all
split: test
revision: c0e8ae955997300d5dbf0e382bf0ba5115f85e8c
metrics: name: single choice
type: accuracy
value: 44.11
verified: no, task: type: question-answering
name: Single Choice Question
dataset: type: cais/mmlu
name: mmlu
config: all
split: test
revision: c30699e
metrics: name: single choice
type: accuracy
value: 50.64
verified: no, task: type: question-answering
name: Single Choice Question
dataset: type: lianghsun/tw-legal-benchmark-v1
name: tw-legal-benchmark-v1
config: all
split: test
revision: 66c3a5f
metrics: name: single choice
type: accuracy
value: 35.24
verified: no
metrics: accuracy
Likes: 22 | All-time downloads: 2467
Created: 2025-04-17 08:15:46