Mimids
Collection
A series of models designed specifically for Roleplaying • 11 items • Updated
spoomplesmaxx-thrasher-24B — MLX 4-bit
4-bit MLX quant of spoomplesmaxx-thrasher-24B
("Thrash Metal", mimids 02) for Apple Silicon. ~13 GB — comfortable on a 24GB
Mac, workable on 16GB with a short context. ChatML template embedded in both
tokenizer_config.json and chat_template.jinja.
pip install mlx-lm
mlx_lm.chat --model aimeri/spoomplesmaxx-thrasher-24B-mlx-4bit
Sampler (swept on the full-precision model): temperature 1.0 · min_p 0.05. A mild repetition_penalty 1.05 eliminated the verbatim-loop tail in our sweep at the cost of a rare unfinished turn — a reasonable opt-in. If you want the higher fidelity, the 6-bit (~18 GB) is the quality pick. See the main card for the full story.
For adults. Stays in character by design; bring your own moderation. Apache 2.0.
- Downloads last month
- 20
Model size
4B params
Tensor type
BF16
·
U32 ·
Hardware compatibility
Log In to add your hardware
4-bit
Model tree for aimeri/spoomplesmaxx-thrasher-24B-mlx-4bit
Base model
mistralai/Mistral-Small-3.1-24B-Base-2503 Finetuned
aimeri/spoomplesmaxx-thrasher-24B