Quantized models - a grimjim Collection

grimjim 's Collections

Quantized models

Full weight models

Mirrored mergekit-ready models

Negative results

Quantized models

updated 1 day ago

Models helpfully quantized by others as well as myself

grimjim/kuno-kunoichi-v1-DPO-v2-SLERP-7B-GGUF

Text Generation • Updated Apr 25 • 110 • 1
Lewdiculous/kuno-kunoichi-v1-DPO-v2-SLERP-7B-GGUF-IQ-Imatrix

Updated Mar 14 • 337 • 9
grimjim/kuno-kunoichi-v1-DPO-v2-SLERP-7B-8.0bpw_h8_exl2

Text Generation • Updated Apr 11 • 3
grimjim/kukulemon-7B-GGUF

Text Generation • Updated Apr 24 • 762 • 1
Lewdiculous/kukulemon-7B-GGUF-IQ-Imatrix

Updated Mar 14 • 1.64k • 7
grimjim/kukulemon-7B-8.0bpw_h8_exl2

Text Generation • Updated Apr 25 • 7
grimjim/kukulemon-32K-7B-GGUF

Text Generation • Updated Apr 27 • 70
grimjim/kukulemon-spiked-9B-GGUF

Text Generation • Updated Apr 27 • 65 • 2
grimjim/kukulemon-spiked-9B-8.0bpw_h8_exl2

Text Generation • Updated Apr 27 • 1
grimjim/kunoichi-lemon-royale-7B-GGUF

Text Generation • Updated Apr 24 • 113 • 1
grimjim/kunoichi-lemon-royale-7B-8.0bpw_h8_exl2

Text Generation • Updated Mar 29 • 4 • 1
grimjim/infinite-lemonade-SLERP-7B-GGUF

Updated Mar 22 • 22
grimjim/fireblossom-32K-7B-GGUF

Text Generation • Updated Apr 15 • 81
Lewdiculous/fireblossom-32K-7B-GGUF-IQ-Imatrix

Updated Apr 19 • 346 • 2
grimjim/fireblossom-32K-7B-4.2bpw_h6_exl2

Text Generation • Updated Apr 18
grimjim/fireblossom-32K-7B-8.0bpw_h8_exl2

Text Generation • Updated Apr 15 • 1
grimjim/llama-3-experiment-v1-9B-GGUF

Text Generation • Updated Apr 29 • 104
grimjim/kunoichi-lemon-royale-v2-32K-7B-GGUF

Text Generation • Updated 20 days ago • 333 • 2
bartowski/kunoichi-lemon-royale-v2-32K-7B-GGUF

Text Generation • Updated 15 days ago • 5.19k • 1
bartowski/kunoichi-lemon-royale-v2-32K-7B-exl2

Text Generation • Updated 15 days ago • 2
mradermacher/kunoichi-lemon-royale-v2-32K-7B-GGUF

Updated 16 days ago • 3.48k • 1
grimjim/zephyr-wizard-kuno-royale-BF16-merge-7B-GGUF

Text Generation • Updated 18 days ago • 130
grimjim/madwind-wizard-7B-GGUF

Text Generation • Updated 15 days ago • 78 • 1
grimjim/cuckoo-starling-32k-7B-GGUF

Text Generation • Updated 14 days ago • 74
grimjim/rogue-enchantress-32k-7B-GGUF

Text Generation • Updated 11 days ago • 145 • 1
grimjim/kunoichi-lemon-royale-v3-32K-7B-GGUF

Text Generation • Updated 4 days ago • 41 • 1
grimjim/kukulemon-v3-soul_mix-32k-7B-GGUF

Text Generation • Updated 1 day ago • 8