Focus-Red-MTP

Detached Multi-Token Prediction (MTP) weights for Jaidchen/Focus-Red, derived from Qwen/Qwen3.8-27B.

This repository is a sidecar, not a standalone causal language model. model.safetensors contains only the 15 original mtp.* tensors, unchanged in dtype, shape, and tensor names from the source checkpoint.

  • dtype: bf16
  • tensors: 15
  • parameters: 424 699 392
  • tensor bytes: 849 398 784
  • MTP layers: 1
  • compatible target: Focus-Red / Qwen 3.8 27B text architecture

The corresponding tensors are intentionally absent from the Focus-Red checkpoint.

Downloads last month
7
Safetensors
Model size
0.4B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Jaidchen/Focus-Red-MTP

Base model

Qwen/Qwen3.8-27B
Finetuned
(1)
this model