Edit Models filters

text-generation-inference

AutoTrain Compatible

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Other with no match

Carbon Emissions

Models

894

Full-text search

Active filters: 6-bit

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated 10 days ago • 179k • 32

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated 18 days ago • 277k • 133

MaziyarPanahi/Phi-3-mini-4k-instruct-v0.3-GGUF

Text Generation • Updated 9 days ago • 2.66k • 5

hjhj3168/Llama-3-8b-Orthogonalized-exl2

Text Generation • Updated about 1 month ago • 1.25k • 86

MaziyarPanahi/Codestral-22B-v0.1-GGUF

Text Generation • Updated about 18 hours ago • 361 • 3

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16 • 10k • 106

MaziyarPanahi/Yi-1.5-6B-Chat-GGUF

Text Generation • Updated 20 days ago • 18.8k • 10

MaziyarPanahi/MixTAO-7Bx2-MoE-Instruct-v7.0-GGUF

Text Generation • Updated Feb 4 • 247 • 10

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19 • 1.24k • 37

llmixer/command-r-plus-6.0bpw-h8-exl2

Text Generation • Updated Apr 8 • 6 • 1

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23 • 4.84k • 74

MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF

Text Generation • Updated Apr 24 • 5.29k • 51

MaziyarPanahi/Llama-3-8B-Instruct-v0.8-GGUF

Text Generation • Updated 15 days ago • 1.65k • 4

LoneStriker/Llama-3-Lumimaid-8B-v0.1-OAS-6.0bpw-h6-exl2

Text Generation • Updated 25 days ago • 19 • 1

LoneStriker/Phi-3-medium-128k-instruct-6.0bpw-h6-exl2

Text Generation • Updated 11 days ago • 26 • 3

MaziyarPanahi/Phi-3-mini-4k-instruct-v0.2-GGUF

Text Generation • Updated 9 days ago • 2.82k • 2

Zoyd/CohereForAI_aya-23-8B-6_0bpw_exl2

Text Generation • Updated 8 days ago • 33 • 2

rhysjones/Phi-3-mini-mango-1-GGUF

Text Generation • Updated 6 days ago • 3.45k • 1

bullerwins/Codestral-22B-v0.1-exl2_6.0bpw

Text Generation • Updated 3 days ago • 8 • 1

MaziyarPanahi/Llama-3-8B-Instruct-v0.9-GGUF

Text Generation • Updated 2 days ago • 12.1k • 1

LoneStriker/Yi-6B-200K-6.0bpw-h6-exl2

Text Generation • Updated Mar 16 • 5 • 1

MaziyarPanahi/phi-2-GGUF

Text Generation • Updated Jan 26 • 265 • 6

MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 26 • 280 • 6

MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 26 • 265 • 4

MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF

Text Generation • Updated Jan 30 • 301 • 4

MaziyarPanahi/NeuralPipe-7B-slerp-GGUF

Text Generation • Updated Jan 26 • 207 • 3

MaziyarPanahi/NeuralPipe-7B-slerp-v0.2-GGUF

Text Generation • Updated Jan 26 • 209 • 2

MaziyarPanahi/Mistral-7B-Instruct-v0.1-16k-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 262 • 2

MaziyarPanahi/rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 204 • 2

MaziyarPanahi/Mistral-7B-Instruct-SQL-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 363 • 1