Edit Models filters

text-generation-inference

AutoTrain Compatible

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,038

new Full-text search

Active filters: quantized

MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF

Text Generation • Updated 8 days ago • 67.6k • 48

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated 12 days ago • 293k • 99

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated 16 days ago • 21.8k • 92

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated 17 days ago • 27k • 66

MaziyarPanahi/Llama-3-8B-Instruct-DPO-v0.3-32k-GGUF

Text Generation • Updated 7 days ago • 1.03k • 8

MaziyarPanahi/Llama-3-8B-Instruct-64k-GGUF

Text Generation • Updated 7 days ago • 98.8k • 7

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated 17 days ago • 24.5k • 69

Lewdiculous/Nyanade_Stunna-Maid-7B-v0.2-GGUF-IQ-Imatrix

Updated 13 days ago • 4.19k • 22

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated 9 days ago • 21.8k • 67

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GPTQ

Text Generation • Updated 14 days ago • 1.69k • 13

argmaxinc/whisperkit-coreml

Updated about 14 hours ago • 577 • 34

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation • Updated 15 days ago • 11.3k • 24

astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • Updated 11 days ago • 1.19k • 13

MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.1-GGUF

Text Generation • Updated about 3 hours ago • 1.06k • 3

FantasiaFoundry/GGUF-Quantization-Script

Text Generation • Updated 2 days ago • 33

MaziyarPanahi/Saul-Instruct-v1-GGUF

Text Generation • Updated Mar 10 • 580 • 5

Lewdiculous/Model-Requests

Updated 7 days ago • 24

MaziyarPanahi/WizardLM-2-8x22B-AWQ

Text Generation • Updated 17 days ago • 5.94k • 6

neuralmagic/bge-base-en-v1.5-quant

Feature Extraction • Updated Nov 13, 2023 • 9.55k • 4

afrideva/phi-2-uncensored-GGUF

Text Generation • Updated Dec 21, 2023 • 2.01k • 7

afrideva/Smol-Llama-101M-Chat-v1-GGUF

Text Generation • Updated Dec 29, 2023 • 128 • 2

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19 • 3.06k • 35

qualcomm/Stable-Diffusion

Unconditional Image Generation • Updated 2 days ago • 11

qualcomm/Baichuan-7B

Text Generation • Updated 2 days ago • 5

qualcomm/Llama-v2-7B-Chat

Text Generation • Updated 2 days ago • 15

Lewdiculous/Loyal-Toppy-Bruins-Maid-7B-DARE-GGUF-Imatrix

Text Generation • Updated Feb 27 • 629 • 10

MaziyarPanahi/yi-super-9B-GGUF

Text Generation • Updated Mar 15 • 600 • 4

Lewdiculous/KukulStanta-7B-GGUF-IQ-Imatrix

Updated 25 days ago • 2.38k • 7

Green-Sky/bark-ggml

Updated 11 days ago • 2

Lewdiculous/Aura_v2_7B-GGUF-IQ-Imatrix

Updated 16 days ago • 1.8k • 6