Qwythos-9B-EMERGED

Qwythos-9B-EMERGED-BF16

A reasoning + agentic distillation of the Qwythos 9B base, trained by Blackfrost AI on The Void. Full 16-bit (BF16) weights. This is the pure-reasoning build — trained on The Void with no marketing or domain data — so the base model's reasoning and tool-use are sharpened without pulling it toward any vertical. It is a vision-language model (multimodal vision inherited from the base — see Vision).

Built on empero-ai/Qwythos-9B-Claude-Mythos-5-1M. Full credit to empero-ai for the base model; Blackfrost contributes The Void distillation.


Overview

Base empero-ai/Qwythos-9B-Claude-Mythos-5-1M — dense qwen3_5 (Qwen3.6-class) 9B, ~9.5B params
Modality Vision-language — text + image + video in, text out (vision tower inherited from base; see Vision)
Method SFT via BF16 LoRA (Unsloth) — rank 32 / α 32, 3 epochs, length-grouped batching, loss masked to assistant turns; adapter merged back to 16-bit
Corpus The Void v4 — ~5,032 multi-turn distilled reasoning + agentic (ReAct-style tool-use) trajectories. No marketing / domain data.
Hardware 8× NVIDIA B200 (DDP)
Precision BF16 (safetensors)
Context 1,048,576 (1M) native, inherited from the base
Architecture Qwen3_5ForConditionalGeneration (qwen3_5), dense, with vision tower

The Void

The Void is Blackfrost's proprietary distillation corpus and method: chain-of-thought reasoning and agentic tool-use trajectories harvested from a panel of frontier teacher models, curated into a clean, domain-neutral training set. Training a base model on The Void concentrates its reasoning and agentic behavior without adding vertical bias. Qwythos-9B-EMERGED is the Void-distilled build of the Qwythos base — the reasoning core, sharpened.

Vision (multimodal)

Qwythos-9B-EMERGED is a vision-language model. The base architecture (Qwen3_5ForConditionalGeneration) carries a full vision tower, and it is present in these weights (~333 vision tensors under model.visual.*) with a Qwen2VLImageProcessor (patch size 16) plus image and video tokens — so the model accepts images and video alongside text.

Scope of Blackfrost's work: The Void v4 distillation was text-only (reasoning + agentic trajectories; LoRA on the language tower). The vision tower is inherited unchanged from the base and was not part of Blackfrost's training or evaluation — multimodal behavior tracks the base model, so validate it for your use case.

The A/B design

EMERGED is one half of a matched pair — both trained from the same base on the same reasoning foundation, differing only in whether a domain corpus was layered on top:

Build Trained on For
Qwythos-9B-EMERGED-BF16 (this repo) The Void v4 only pure reasoning / agentic — no vertical bias
BF-BIS-SERIES-MARKETING-9B The Void v4 + a marketing/business corpus brand voice, ad copy, marketing strategy

The pair isolates the effect of layering a domain corpus on top of the same reasoning foundation.

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "Blackfrost-AI/Qwythos-9B-EMERGED-BF16"
tok = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype="bfloat16", device_map="auto")

messages = [{"role": "user", "content": "Explain why a hash table has O(1) average lookup."}]
inputs = tok.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt").to(model.device)
out = model.generate(inputs, max_new_tokens=1024)
print(tok.decode(out[0][inputs.shape[-1]:], skip_special_tokens=True))

Generate with thinking enabled to surface the distilled reasoning trace. For image/video input, load with the multimodal processor (AutoProcessor / AutoModelForImageTextToText) and use the packaged chat template.

Status & limitations

  • Generation-verified by Blackfrost on text (loads and produces coherent reasoning); not yet published with a full public benchmark suite. Vision is inherited from the base and not independently evaluated.
  • A 9B model — verify important facts. It inherits the characteristics and limitations of the base model.
  • License is Apache-2.0, inherited from the base.

Trained and released by Blackfrost AI on The Void. Base model by empero-ai (Apache-2.0).

Downloads last month
308
Safetensors
Model size
9B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Blackfrost-AI/Qwythos-9B-EMERGED-BF16

Finetuned
Qwen/Qwen3.5-9B
Finetuned
(7)
this model

Collection including Blackfrost-AI/Qwythos-9B-EMERGED-BF16