Instructions to use wesjos/mario-html-v2-9B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use wesjos/mario-html-v2-9B with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="wesjos/mario-html-v2-9B")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("wesjos/mario-html-v2-9B")
model = AutoModelForMultimodalLM.from_pretrained("wesjos/mario-html-v2-9B", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use wesjos/mario-html-v2-9B with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "wesjos/mario-html-v2-9B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "wesjos/mario-html-v2-9B",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/wesjos/mario-html-v2-9B

SGLang

How to use wesjos/mario-html-v2-9B with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "wesjos/mario-html-v2-9B" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "wesjos/mario-html-v2-9B",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "wesjos/mario-html-v2-9B" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "wesjos/mario-html-v2-9B",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use wesjos/mario-html-v2-9B with Docker Model Runner:
```
docker model run hf.co/wesjos/mario-html-v2-9B
```
Browse Quantizations to use this model in llama.cpp, Ollama, LM Studio, or any compatible app.

🍄 Mario-HTML-v2-9B

V2: less html tag in Cot than v1.

GGUF / llama.cpp build: wesjos/mario-html-v2-9B-GGUF — Q8_0 · Q4_K_M + BF16 mmproj. The quant table and the llama.cpp launch lines live on that card.


Base	`Qwen/Qwen3.5-9B` · 9.65 B (bf16) · 17.98 GiB
Architecture	`Qwen3_5ForConditionalGeneration` · 32 layers (24 linear + 8 full attention, interval 4) · hidden 4096
Context	262,144 native
Modalities	text → HTML, text + image → HTML

🖼️ Demo

All shots are the WebUI (shipped with the mario-html-v2-4B repo, theme_preset: editorial) with the CoT toggle switched on — its webui/config.json ships enable_thinking: false, which hides the reasoning panel entirely, so flip it if you want to see the traces. The panel above each answer is the raw <think> stream; the page below it is the unmodified render.

Microservices vs. Monolith — comparison grid

Compare Microservices vs Monolith architecture in a modern comparison grid (two-card grid, callouts, metric tiles and a head-to-head table; reasoning panel collapsed)

Architecture comparison demo: a verdict callout, a two-card Monolith vs Microservices grid with BEST FOR / RISK / OPS / TRADE-OFF bullets, metric tiles, and a head-to-head comparison table

Step-by-step math, CoT expanded

Solve the linear equation: 2x + 5 = 17 step by step (the <think> stream is pure plain-text planning — zero HTML tags — while the answer renders as cards, code blocks and a stepper)

Math demo: reasoning panel expanded above the answer, showing plain-text planning followed by a rendered step-by-step solution with code blocks and a golden-rule callout

Vision input

llama photo + what is this (image paste via Ctrl+V, answered as a llama-vs-alpaca breakdown)

Vision demo: an uploaded llama photo with the question 'what is this', answered with a two-card llama-vs-alpaca comparison, a feature table and characteristic tiles

📤 Output Contract

One root element; everything else is an optional child. Class list verified against webui/static/theme.css (shipped with the mario-html-v2-4B repo):

Component	Markup
Root	`<div class="ai-view">`
Summary	`<div class="summary">` · `<div class="summary-card">` · `<p class="lead">`
Card	`<div class="card">`
Grid	`<div class="grid grid-2">` · `<div class="grid grid-3">`
Metrics	`<div class="metric-group"><div class="metric-card"><span class="metric-label">…</span><span class="metric-value">…</span><span class="metric-sub">…</span></div></div>`
Stepper	`<div class="stepper"><div class="step-item">…</div></div>`
Callout	`<div class="callout callout-info\|warning\|success\|danger"><div class="callout-header">…</div></div>`
Badge	`<span class="badge badge-info\|success\|warning\|danger\|accent">`
Table	`<div class="table-container"><table class="modern-table">…</table></div>`
Feature list	`<div class="feature-list"><div class="feature-item">…</div></div>`
Code block	`<div class="code-box"><div class="code-header"><span class="code-title">…</span></div>…</div>`

Raw sample (message.content verbatim, v2 zero-system-prompt greedy)

<div class="ai-view">
<h3>为什么天空是蓝色的？</h3>
<div class="summary">
<p class="lead">阳光中的蓝光被大气中的分子"散射"到四面八方，而我们的眼睛对蓝光更敏感，所以我们看到天空是蓝色的。</p>
</div>
<div class="card">
<h4>三句话解释</h4>
<div class="step-list"><div class="step-item">…</div></div>
</div>
</div>

The <think> trace that precedes this sample contains zero HTML tags — pure plain-text planning ("a summary lead, then a three-item stepper..."). Two classes in the sample are content-only: step-list and ai-view-header are not in theme.css, so they render with default block styling — define your own if you want tighter control. (step-item itself is styled.)

🎨 WebUI

The WebUI ships with the sibling 4B repo — clone wesjos/mario-html-v2-4B, point webui/config.json at your serving endpoint for this model, and:

cd webui
pip install -r requirements.txt
python server.py --port 8791

Open http://localhost:8791. Dual-stream rendering (collapsible <think> + live HTML), clipboard image paste (Ctrl+V), nine theme presets (default · apple · notion · cyber · editorial · cards_rounded · glassmorphism · soft_shadows · compact) plus live custom CSS, and a raw-source / copy-HTML view per message.

⚠️ Notes

The output is HTML, not Markdown. Feed it a Markdown renderer and you get raw tags.
Serve with a clear/absent system prompt — the zero-system-prompt path is the trained one.
The model picks from the class vocabulary above; arbitrary new CSS classes are not a contract. Custom theme.css is the supported way to restyle.
Arithmetic is reliable but not bank-grade — check long decimal chains.
--reasoning-parser qwen3 needs a recent vLLM.

📄 License

Apache License 2.0.

Downloads last month: 31

Safetensors

Model size

10B params

Tensor type

BF16

F32

Model tree for wesjos/mario-html-v2-9B

Base model

Qwen/Qwen3.5-9B-Base

Finetuned

Qwen/Qwen3.5-9B

Finetuned

(1090)

this model

Quantizations

3 models

wesjos
/

mario-html-v2-9B