Edit Models filters

Inference status

Misc

Inference Endpoints

4-bit precision

8-bit precision

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

848

Full-text search

Active filters: imatrix

legraphista/Yi-9B-Coder-IMat-GGUF

Text Generation • Updated Jun 27 • 1.37k

legraphista/gemma-2-9b-it-IMat-GGUF

Text Generation • Updated Jun 30 • 1.49k • 2

legraphista/gemma-2-27b-it-IMat-GGUF

Text Generation • Updated Sep 20 • 2.9k • 20

legraphista/llm-compiler-7b-IMat-GGUF

Text Generation • Updated Jun 27 • 1.16k

legraphista/llm-compiler-7b-ftd-IMat-GGUF

Text Generation • Updated Jun 28 • 1k • 2

legraphista/llm-compiler-13b-IMat-GGUF

Text Generation • Updated Jun 28 • 755 • 3

legraphista/llm-compiler-13b-ftd-IMat-GGUF

Text Generation • Updated Jun 28 • 1.05k

duyntnet/gemma-2-9b-it-imatrix-GGUF

Text Generation • Updated Sep 7 • 447 • 1

duyntnet/Llama-2-7b-chat-hf-imatrix-GGUF

Text Generation • Updated Jun 29 • 38

duyntnet/Xwin-MLewd-13B-V0.2-imatrix-GGUF

Text Generation • Updated Jun 30 • 157

duyntnet/gemma-2-27b-it-imatrix-GGUF

Text Generation • Updated Sep 9 • 176 • 2

legraphista/Gemma-2-9B-It-SPPO-Iter3-IMat-GGUF

Text Generation • Updated Jul 5 • 2.03k • 3

duyntnet/Yi-6B-200K-imatrix-GGUF

Text Generation • Updated Jul 1 • 354

qwp4w3hyb/Gemma-2-9B-It-SPPO-Iter3-iMat-GGUF

Text Generation • Updated Jul 3 • 62

duyntnet/Jellyfish-13B-imatrix-GGUF

Text Generation • Updated Jul 3 • 333 • 1

legraphista/Phi-3-mini-4k-instruct-update2024_07_03-IMat-GGUF

Text Generation • Updated Jul 3 • 825

legraphista/internlm2_5-7b-chat-IMat-GGUF

Text Generation • Updated Aug 5 • 942

legraphista/internlm2_5-7b-chat-1m-IMat-GGUF

Text Generation • Updated Jul 3 • 437 • 1

duyntnet/TheSpice-7b-FT-v0.3.1-imatrix-GGUF

Text Generation • Updated Jul 4 • 201

legraphista/codegeex4-all-9b-IMat-GGUF

Text Generation • Updated Jul 6 • 1.39k • 9

duyntnet/Phi-3-mini-4k-instruct-imatrix-GGUF

Text Generation • Updated Jul 6 • 109

duyntnet/WizardLM-13B-V1.2-imatrix-GGUF

Text Generation • Updated Jul 9 • 166 • 1

duyntnet/zephyr-7b-sft-full-SPIN-iter3-imatrix-GGUF

Text Generation • Updated Jul 11 • 78 • 1

legraphista/NuminaMath-7B-TIR-IMat-GGUF

Text Generation • Updated Jul 11 • 891 • 1

duyntnet/glm-4-9b-chat-imatrix-GGUF

Text Generation • Updated Jul 12 • 480 • 1

duyntnet/SeaLLM3-7B-Chat-imatrix-GGUF

Text Generation • Updated Jul 14 • 232 • 1

duyntnet/Asclepius-Llama2-13B-imatrix-GGUF

Text Generation • Updated Jul 17 • 10

legraphista/mathstral-7B-v0.1-IMat-GGUF

Text Generation • Updated Jul 16 • 466

qwp4w3hyb/Mistral-Nemo-Instruct-2407-iMat-GGUF

Text Generation • Updated Jul 24 • 542 • 6

duyntnet/Qwen1.5-7B-Chat-imatrix-GGUF

Text Generation • Updated Jul 19 • 81