Qwythos-9B-Claude-Mythos-5-1M-mlx
Collection
公式のモデルを自分でmlxに変換したもの。 • 6 items • Updated
Qwythos-9B-Claude-Mythos-5-1M MLX (4bit)
A conversion of empero-ai/Qwythos-9B-Claude-Mythos-5-1M to Apple's MLX format, quantized to 4bit.
- Conversion tool: mlx-maker /
mlx-vlm - Source model:
empero-ai/Qwythos-9B-Claude-Mythos-5-1M - Base model:
Qwen/Qwen3.5-9B - License: Apache-2.0 (inherited from the source model)
About the chat template
Uses the original chat_template.jinja from the upstream model as-is (the model identifies itself as Qwythos / Empero AI).
Usage (mlx-vlm)
uv add mlx-vlm
from mlx_vlm import load, generate
from mlx_vlm.prompt_utils import apply_chat_template
model, processor = load("ToPo-ToPo/Qwythos-9B-Claude-Mythos-5-1M-mlx-4bit")
messages = [{"role": "user", "content": "Hello"}]
prompt = apply_chat_template(processor, model.config, messages)
print(generate(model, processor, prompt, max_tokens=256))
This repository is a derivative work distributed under Apache-2.0. The original attribution and license are inherited as noted above.
- Downloads last month
- 60
Model size
2B params
Tensor type
BF16
·
U32 ·
Hardware compatibility
Log In to add your hardware
4-bit
Model tree for ToPo-ToPo/Qwythos-9B-Claude-Mythos-5-1M-mlx-4bit
Base model
Qwen/Qwen3.5-9B-Base Finetuned
Qwen/Qwen3.5-9B Finetuned
empero-ai/Qwythos-9B-Claude-Mythos-5-1M