Edit Models filters

text-generation-inference

AutoTrain Compatible

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Other with no match

Carbon Emissions

Models

1,036

Full-text search

Active filters: 3-bit

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated 27 days ago • 520k • 41

MaziyarPanahi/Qwen2-1.5B-Instruct-GGUF

Text Generation • Updated 12 days ago • 170k • 7

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated Apr 15 • 3.29k • 74

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14 • 108k • 140

MaziyarPanahi/Llama-3-8B-Instruct-64k-GGUF

Text Generation • Updated Apr 25 • 26.9k • 12

MaziyarPanahi/em_german_leo_mistral-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 248 • 2

MaziyarPanahi/Noromaid-7b-v0.1.1-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 209 • 1

MaziyarPanahi/Noromaid-7b-v0.2-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 29 • 211 • 1

MaziyarPanahi/Noromaid-7b-v0.1.1-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 29 • 207 • 1

MaziyarPanahi/Kunoichi-7B-GGUF

Text Generation • Updated Feb 4 • 349 • 1

MaziyarPanahi/gemma-7b-GGUF

Text Generation • Updated Feb 29 • 766 • 10

MaziyarPanahi/gemma-7b-it-GGUF

Text Generation • Updated Feb 27 • 337 • 7

MaziyarPanahi/BioMedGPT-LM-7B-GGUF

Text Generation • Updated Mar 17 • 302 • 4

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15 • 7.23k • 69

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16 • 4.74k • 107

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation • Updated Apr 18 • 37.5k • 30

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23 • 6.26k • 75

MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF

Text Generation • Updated Apr 24 • 2.87k • 53

MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.4-GGUF

Text Generation • Updated May 7 • 600 • 9

MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.2-GGUF

Text Generation • Updated May 8 • 400 • 2

MaziyarPanahi/Phi-3-Context-Obedient-RAG-GGUF

Text Generation • Updated May 10 • 250 • 4

MaziyarPanahi/Codestral-22B-v0.1-GGUF

Text Generation • Updated 17 days ago • 50.4k • 7

MaziyarPanahi/Llama-3-8B-Instruct-v0.9-GGUF

Text Generation • Updated 19 days ago • 12.5k • 2

MaziyarPanahi/Qwen2-7B-Instruct-GGUF

Text Generation • Updated 12 days ago • 72.5k • 6

LoneStriker/Qwen2-72B-Instruct-3.0bpw-h6-exl2

Text Generation • Updated 12 days ago • 5 • 1

IlyaGusev/saiga_llama3_70b_sft_m1_d5_abliterated_gptq_3bit

Text Generation • Updated 2 days ago • 3 • 1

MaziyarPanahi/mergekit-ties-zwxzpdk-GGUF

Text Generation • Updated 1 day ago • 1.98k • 1

MaziyarPanahi/mergekit-ties-vjlpsxw-GGUF

Text Generation • Updated 1 day ago • 1.72k • 1

kim512/L3-70B-daybreak-storywriter-v0.4-3.0bpw-h6-exl2

Text Generation • Updated 16 days ago • 1

LoneStriker/Maiden-Unquirked-20B-3.0bpw-h6-exl2

Text Generation • Updated 5 days ago • 1