Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

4,121

Full-text search

Active filters: gguf-my-repo

YorkieOH10/dolphin-2.9.1-yi-1.5-34b-Q8_0-GGUF

Updated May 18 • 8

helloAI333/TinyLlama-Cinder-Agent-Rag-Q8_0-GGUF

Updated May 18 • 14 • 1

NikolayKozloff/RoLlama2-7b-Instruct-Q8_0-GGUF

Updated May 18 • 7 • 1

Cran-May/openbuddy-mistral-22b-v21.1-32k-Q4_K_M-GGUF

Text Generation • Updated May 18 • 10

NikolayKozloff/RoLlama2-7b-Chat-Q8_0-GGUF

Updated May 18 • 10 • 1

NikolayKozloff/RoLlama2-7b-Base-Q8_0-GGUF

Updated May 18 • 8 • 1

NikolayKozloff/RoMistral-7b-Instruct-Q8_0-GGUF

Updated May 18 • 8 • 1

Cran-May/openbuddy-mistral-22b-v21.1-32k-Q4_K_S-GGUF

Text Generation • Updated May 18 • 10

Ransss/Kuro-Lotus-10.7B-Q8_0-GGUF

Updated May 18 • 7

Ransss/Fimbulvetr-10.7B-v1-Q8_0-GGUF

Updated May 18 • 10 • 1

Ransss/Fimbulvetr-11B-v2-Q8_0-GGUF

Updated May 18 • 8 • 1

Ransss/flammen24X-mistral-7B-Q8_0-GGUF

Updated May 18 • 7

Recaru/gemma-ko-2b-Q4_K_M-GGUF

Text Generation • Updated May 18 • 11

Recaru/gemma-ko-1.1-2b-it-Q5_K_M-GGUF

Updated May 18 • 12

AlirezaF138/PersianLLaMA-13B-Q6_K-GGUF

Text Generation • Updated May 19 • 17

AlirezaF138/PersianLLaMA-13B-Q5_K_M-GGUF

Text Generation • Updated May 19 • 8

AlirezaF138/PersianLLaMA-13B-Instruct-Q6_K-GGUF

Text Generation • Updated May 19 • 13

AlirezaF138/PersianLLaMA-13B-Instruct-Q5_K_M-GGUF

Text Generation • Updated May 19 • 15 • 1

cminja/Phi-3-mini-128k-instruct-Q4_K_M-GGUF

Text Generation • Updated May 19 • 10

cminja/vicuna-13b-v1.5-Q4_K_M-GGUF

Updated May 19 • 9

NikolayKozloff/Master-Yi-9B-Q4_0-GGUF

Updated May 19 • 16 • 1

hansmueller464/Llama3-Aloe-8B-Alpha-Q6_K-GGUF

Question Answering • Updated May 19 • 22

cminja/Llama-3-8B-Lexi-Uncensored-Q8_0-GGUF

Updated May 19 • 15 • 1

ccarrez/meditron-7b-Q4_K_M-GGUF

Updated May 19 • 7

cminja/Phi-3-mini-128k-instruct-Q8_0-GGUF

Text Generation • Updated May 19 • 8

hansmueller464/Llama3-Aloe-8B-Alpha-Q8_0-GGUF

Question Answering • Updated May 19 • 25

cminja/Hebrew-Mistral-7B-Q4_K_M-GGUF

Updated May 19 • 9

cminja/Llama-3-8B-Instruct-Gradient-1048k-Q4_K_M-GGUF

Text Generation • Updated May 19 • 11 • 1

VlSav/Hermes-2-Pro-Llama-3-8B-Q6_K-GGUF

Updated May 21 • 14

kpkiosk66/LemonKunoichiWizardV3-Q6_K-GGUF

Updated May 19 • 8