Distill
Collection
Models built for distill — CLI output compression and classification. https://github.com/samuelfaj/distill • 6 items • Updated
distill-1.7B-4bit-GGUF
4-bit GGUF (Q4_K_M) of distill-1.7B — an Expert Language Model for CLI output compression. Zero accuracy loss.
| Format | Size | Accuracy |
|---|---|---|
| GGUF fp16 | 4.1 GB | 95% |
| GGUF Q4_K_M | 1.2 GB | 95% |
Use with LM Studio, Ollama, or llama.cpp. Built for distill.
Model tree for samuelfaj/distill-1.7B-GGUF
Base model
Qwen/Qwen3-1.7B-Base Finetuned
Qwen/Qwen3-1.7B Finetuned
samuelfaj/distill-1.7B-MLX Quantized
samuelfaj/distill-1.7B-4bit-MLX