Auto-Quantized GGUF Model

This repository contains automated GGUF quantization files for Nubinu/Qwen3.5-4B-MiniFantasy.

The calibration data for the imatrix is targeted at Chinese novels and role-playing (RP), while preserving logic and common sense.
imatrix 的校准数据以中文的小说、角色扮演为目标，同时保留逻辑和常识。

📊 Perplexity Evaluation

(Tested against the provided calibration dataset)

Base (F16/BF16): PPL = 16.5300 +/- 0.13828
IQ4_XS: PPL = 14.1688 +/- 0.11587
Q4_K_M: PPL = 14.0570 +/- 0.11458
Q5_K_M: PPL = 13.9765 +/- 0.11426

Downloads last month: 655

GGUF

Model size

4B params

Architecture

qwen35

Hardware compatibility

4-bit

5-bit

View +1 variant

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for nuofang/Qwen3.5-4B-MiniFantasy-GGUF

Base model

Qwen/Qwen3.5-4B-Base

Finetuned

Qwen/Qwen3.5-4B

Finetuned

MuXodious/Qwen3.5-4B-SOMPOA-heresy-v2

Finetuned

Nubinu/Qwen3.5-4B-MiniFantasy

Quantized

(4)

this model