Language: English | 中文

InnoSpark3.0-35B-260709

InnoSpark3.0-35B-260709 is an education-enhanced 35B model in the InnoSpark3.0 series. It is trained from the NEX 35B model family and evaluated against Qwen3.6-35B-A3B and Nex-N2-mini.

InnoSpark3.0-35B-260709 is designed for educational QA, teaching assistance, learning companionship, and classroom or homework scenarios, including explanation generation, scaffolded instruction, guided reasoning, and pedagogical strategy suggestions. We use both general and education-domain data during SFT, and further strengthen reasoning, educational QA, agentic capabilities, and instruction following through a multi-stage RL pipeline. We did not specifically optimize visual capabilities; vision-language metrics are reported for transparency.

Model Details

Item	Description
Model name	InnoSpark3.0-35B-260709
Training source	NEX 35B model family
Reference baselines	Qwen3.6-35B-A3B, Nex-N2-mini
Parameters	35B
Training pipeline	SFT + multi-stage RL
SFT data	General data + education-domain data
RL focus	Reasoning, educational QA, agent scenarios, instruction following
Primary use cases	Education QA, tutoring, teaching support, educational agents, general assistant tasks

Training

The post-training pipeline contains two major stages:

1. Supervised Fine-Tuning (SFT): uses a mixture of general instruction data and education-domain data to strengthen the model's ability to answer pedagogical questions, explain concepts, and follow classroom-oriented instructions.
2. Multi-stage Reinforcement Learning (RL): improves reasoning, education-specific QA, agentic task solving, and instruction-following robustness through staged optimization.

Evaluation

All scores below are normalized to a 100-point scale. For EduBench, the original scores in the evaluation sheet are on a 10-point scale and are multiplied by 10 here. Bold values indicate the best score in each row. Missing results are shown as -.

General Benchmarks

Type	Capability	Benchmark	Qwen3.6-35B-A3B	Nex-N2-mini	InnoSpark3.0-35B
Language	Knowledge	MMLU-Pro	84.89	84.53	84.89
Language	Knowledge	C-Eval	90.49	90.19	91.68
Language	Knowledge	SimpleQA-Verified	21.8	23.8	22.8
Language	Instruction Following	IF-Eval	92.42	89.1	93.72
Language	Instruction Following	IF-bench	64.97	53.06	68
Language	STEM & Reasoning	GPQA Diamond	80.3	82.6	86.36
Language	STEM & Reasoning	LiveCodeBench v6	83.03	58.01	60.09
Language	STEM & Reasoning	AIME25	86.67	83.33	80
Language	STEM & Reasoning	AIME26	60	63.33	90
Language	Coding Agent	SWE-bench Verified-Agentic	57	74.4	64.4
Language	Coding Agent	Terminal-Bench 2.1	41.57	60.7	33.7
Language	General Agent	BFCL_v4	67.43	65.81	65.92
Language	General Agent	TAU3-bench	59.73	65.9	60.42
Vision-Language	STEM & Puzzle	MMMU-Pro	80.81	79.83	80.92
Vision-Language	General VQA	MMBenchEN-DEV-v1.1	91.52	92.02	92.52
Vision-Language	Document Understanding	OCRBench	87.3	85.5	85.8

Education Benchmarks

The education evaluation covers EduBench and Pedagogy-oriented evaluation settings. The table below reports the detailed EduBench and Pedagogy Benchmark Multilingual metrics provided in the evaluation sheet.

Benchmark	Metric	Qwen3.6-35B-A3B	Nex-N2-mini	InnoSpark3.0-35B
EduBench	Total	89.6	89.2	96.6
EduBench	Instruction Following & Task Completion	98.3	92.2	98.6
EduBench	Role & Tone Consistency	92.5	92	99.3
EduBench	Content Relevance & Scope Control	98.9	96.8	99.4
EduBench	Basic Factual Accuracy	97.9	93.3	98.9
EduBench	Domain Knowledge Accuracy	92.4	92.9	98.8
EduBench	Clarity, Simplicity & Inspiration	87.5	87.1	95.1
EduBench	Higher-Order Thinking & Skill Development	78.1	76	92.4
EduBench	Scenario Element Integration	47.9	72.3	81.9
EduBench	Personalization, Adaptation & Learning Support	95	95.8	99.9
EduBench	Reasoning Process Rigor	96.5	94.7	98.7
Pedagogy Benchmark Multilingual	Average	85.76	84.67	95.76
Pedagogy Benchmark Multilingual	评估	86.55	86.1	95.96
Pedagogy Benchmark Multilingual	课堂管理	100	100	100
Pedagogy Benchmark Multilingual	教育理论	93.33	93.33	100
Pedagogy Benchmark Multilingual	学生理解	81.94	80.18	94.27
Pedagogy Benchmark Multilingual	教学策略	83.53	85.61	96.29

Usage

Transformers

import torch
from transformers import AutoProcessor, AutoModelForMultimodalLM

model_id = "sii-research/InnoSpark3.0-35B-260709"

processor = AutoProcessor.from_pretrained(model_id, trust_remote_code=True)
model = AutoModelForMultimodalLM.from_pretrained(
    model_id,
    torch_dtype="auto",
    device_map="auto",
    trust_remote_code=True,
)

messages = [
    {
        "role": "user",
        "content": [
            {
                "type": "text",
                "text": "请用适合初中生的方式讲解一元二次方程的求根公式，并给出一个例题。",
            }
        ],
    }
]

inputs = processor.apply_chat_template(
    messages,
    add_generation_prompt=True,
    tokenize=True,
    return_dict=True,
    return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=1024)
response = processor.decode(
    outputs[0][inputs["input_ids"].shape[-1]:],
    skip_special_tokens=True,
)
print(response)

vLLM

vllm serve sii-research/InnoSpark3.0-35B-260709 --trust-remote-code

Intended Use

InnoSpark3.0-35B-260709 is intended for research and application development in education-focused AI scenarios, including:

• Concept explanation and step-by-step tutoring
• Educational QA and homework support
• Lesson planning and teaching material generation
• Student-facing dialogue agents
• Teacher-facing assistant workflows
• General instruction following, reasoning, and agent-style tasks

Limitations

Like other large language models, InnoSpark3.0-35B-260709 may generate inaccurate, incomplete, or biased content. Outputs in educational settings should be reviewed by qualified educators when used for high-stakes learning, assessment, or student guidance. The model should not be used as the sole source for factual verification, grading decisions, psychological counseling, medical advice, legal advice, or other safety-critical decisions.

Evaluation results may vary with prompt format, decoding parameters, evaluation implementation, and data version. Users should conduct additional evaluations before deploying the model in production or classroom environments.

Main Contributions

Name	Responsibility	Personal link
Wentao Liu (刘文涛)	Training pipeline; SFT general and education data processing; education RL training	Google Scholar
Siyu Song (宋思宇)	RL training environment infrastructure; general RL training; education RL training	Google Scholar
Ye Lu (卢烨)	SFT training; RL for instruction-following capability	GitHub, Google Scholar
Xuanhao Xie (谢轩豪)	RL training environment infrastructure; synthesis and training of general and education SFT data	Homepage
Shengyao Wang (王圣尧)	RL data processing and training for education-agent scenarios	GitHub
Yi Qian (钱毅)	General and education benchmark evaluation	GitHub
Jiahao Liu (刘家豪)	General and education benchmark evaluation	GitHub
Wenbo Wu (吴文博)	General-agent evaluation pipeline construction	Homepage

Citation

@misc{innospark3_35b_260709,
  title = {InnoSpark3.0-35B-260709},
  author = {SII Research},
  year = {2026},
  howpublished = {\url{https://huggingface.co/sii-research/InnoSpark3.0-35B-260709}}
}

Please also follow the citation and license requirements of the related base and reference models.