Edit Models filters

8-bit precision

AutoTrain Compatible

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

Other with no match

Carbon Emissions

Models

2,817

Full-text search

Active filters: 8-bit

Qwen/Qwen2-7B-Instruct-GPTQ-Int8

Text Generation • Updated 7 days ago • 1.99k • 8

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14 • 119k • 140

astronomer/Llama-3-8B-Instruct-GPTQ-8-Bit

Text Generation • Updated Apr 22 • 7.79k • 21

MaziyarPanahi/Qwen2-1.5B-Instruct-GGUF

Text Generation • Updated 10 days ago • 122k • 7

Undi95/Leyley-13B-Lora

Text Generation • Updated Nov 26, 2023 • 2 • 4

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16 • 4.89k • 107

MaziyarPanahi/Llama-3-8B-Instruct-64k-GGUF

Text Generation • Updated Apr 25 • 30.4k • 12

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated 25 days ago • 476k • 39

Qwen/Qwen2-72B-Instruct-GPTQ-Int8

Text Generation • Updated 7 days ago • 1.22k • 7

atcsecure/dolphin-2.9.2-qwen72b-8.0bpw-h8-exl2

Text Generation • Updated 7 days ago • 3 • 2

Statuo/EtherealRainbow-v0.2-8B_EXL2_8BPW

Text Generation • Updated 4 days ago • 31 • 2

Norod78/gpt-fluentui-flat-svg

Text Generation • Updated Mar 19, 2023 • 1.08k • 14

Abzu/mpt-7b-storywriter-q8

Text Generation • Updated Jul 7, 2023 • 8 • 2

Undi95/Llama2-13B-no_robots-alpaca-lora

Text Generation • Updated Nov 17, 2023 • 3.14k • 9

Qwen/Qwen-72B-Chat-Int8

Text Generation • Updated Jan 4 • 44 • 15

Neurai/NeuraLlama7b

Text Generation • Updated Jan 1 • 55 • 2

MaziyarPanahi/em_german_leo_mistral-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 208 • 2

MaziyarPanahi/Noromaid-7b-v0.1.1-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 169 • 1

MaziyarPanahi/Noromaid-7b-v0.2-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 29 • 171 • 1

MaziyarPanahi/Noromaid-7b-v0.1.1-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 29 • 211 • 1

MaziyarPanahi/Kunoichi-7B-GGUF

Text Generation • Updated Feb 4 • 358 • 1

MaziyarPanahi/gemma-7b-GGUF

Text Generation • Updated Feb 29 • 762 • 10

MaziyarPanahi/gemma-7b-it-GGUF

Text Generation • Updated Feb 27 • 379 • 7

LoneStriker/luxia-21.4b-alignment-v1.0-8.0bpw-h8-exl2

Text Generation • Updated Mar 12 • 2 • 1

MaziyarPanahi/BioMedGPT-LM-7B-GGUF

Text Generation • Updated Mar 17 • 258 • 4

PrunaAI/mosaicml-mpt-7b-storywriter-bnb-8bit-smashed

Text Generation • Updated Apr 11 • 1 • 1

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated Apr 15 • 3.3k • 73

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15 • 7.56k • 69

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation • Updated Apr 18 • 45.4k • 30

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23 • 5.75k • 75