Edit Models filters

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Inference Endpoints

Mixture of Experts

Other with no match

Carbon Emissions

Models

748

Full-text search

Active filters: 2-bit

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated 24 days ago • 454k • 39

MaziyarPanahi/Qwen2-1.5B-Instruct-GGUF

Text Generation • Updated 9 days ago • 98.6k • 6

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16 • 5.17k • 107

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14 • 119k • 139

MaziyarPanahi/Llama-3-8B-Instruct-64k-GGUF

Text Generation • Updated Apr 25 • 30.4k • 12

MaziyarPanahi/Qwen2-7B-Instruct-GGUF

Text Generation • Updated 9 days ago • 70.5k • 6

MaziyarPanahi/em_german_leo_mistral-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 260 • 2

MaziyarPanahi/Noromaid-7b-v0.1.1-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 218 • 1

MaziyarPanahi/Noromaid-7b-v0.2-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 29 • 221 • 1

MaziyarPanahi/Noromaid-7b-v0.1.1-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 29 • 211 • 1

MaziyarPanahi/Kunoichi-7B-GGUF

Text Generation • Updated Feb 4 • 361 • 1

MaziyarPanahi/gemma-7b-GGUF

Text Generation • Updated Feb 29 • 769 • 10

MaziyarPanahi/gemma-7b-it-GGUF

Text Generation • Updated Feb 27 • 382 • 7

MaziyarPanahi/BioMedGPT-LM-7B-GGUF

Text Generation • Updated Mar 17 • 258 • 4

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated Apr 15 • 3.31k • 73

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15 • 7.57k • 69

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation • Updated Apr 18 • 45.4k • 30

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23 • 5.88k • 75

MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF

Text Generation • Updated Apr 24 • 3.27k • 53

MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.4-GGUF

Text Generation • Updated May 7 • 533 • 9

MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.2-GGUF

Text Generation • Updated May 8 • 325 • 2

MaziyarPanahi/Phi-3-Context-Obedient-RAG-GGUF

Text Generation • Updated May 10 • 221 • 4

MaziyarPanahi/Codestral-22B-v0.1-GGUF

Text Generation • Updated 14 days ago • 49.9k • 7

MaziyarPanahi/Llama-3-8B-Instruct-v0.9-GGUF

Text Generation • Updated 16 days ago • 12.4k • 2

Ayushnangia/bloom3B-2bit-gptq

Text Generation • Updated Aug 28, 2023 • 6

kaitchup/Llama-2-7b-gptq-2bit

Text Generation • Updated Sep 11, 2023 • 84 • 1

nesty/sg-bart-large-4096-gptq-2bit

Text2Text Generation • Updated Sep 21, 2023 • 2

Arylwen/instruct-palmyra-20b-gptq-2

Text Generation • Updated Oct 5, 2023 • 6

lebe1/opt-125m-2bit

Text Generation • Updated Nov 21, 2023 • 1

Sujan42024/dlite-v2-1_5b-2bitQuantization

Text Generation • Updated Nov 28, 2023 • 5