Edit Models filters

Inference Endpoints

text-generation-inference

Mixture of Experts

AutoTrain Compatible

Carbon Emissions

8-bit precision

Other with no match

4-bit precision

text-embeddings-inference

Models

2,799

Full-text search

Active filters: llama-cpp

NikolayKozloff/Llama-3SOME-8B-v2-Q4_K_S-GGUF

Updated 7 days ago • 448 • 1

NikolayKozloff/Llama-3SOME-8B-v2-IQ4_NL-GGUF

Updated 7 days ago • 445 • 1

NikolayKozloff/Llama-3SOME-8B-v2-IQ4_XS-GGUF

Updated 7 days ago • 896 • 1

Casual-Autopsy/L3-Umbral-Mind-RP-v2.0-8B-Q8_0-GGUF

Text Generation • Updated 1 day ago • 64 • 1

arkii/chatglm2-6b-ggml

Updated Jul 26, 2023 • 6

pcuenq/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF

Updated Mar 29 • 41

reach-vb/phi-2-Q2_K-GGUF

Text Generation • Updated Mar 27 • 28

reach-vb/TinyLlama-1.1B-Chat-v1.0-Q2_K-GGUF

Updated 9 days ago • 114

reach-vb/TinyLlama-1.1B-Chat-v1.0-Q8_0-GGUF

Updated Mar 27 • 18

osanseviero/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF

Updated Mar 27 • 27

LeroyDyer/Mixtral_AI_Multi_Modality_7b

Updated Mar 29 • 21

reach-vb/TinyLlama-1.1B-Chat-v1.0-Q6_K-GGUF

Updated Mar 28 • 27

ProCreations/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF

Updated Mar 29 • 25

ProCreations/Qwen1.5-0.5B-Q4_K_M-GGUF

Text Generation • Updated Mar 29 • 41

ProCreations/Qwen1.5-4B-Q5_0-GGUF

Text Generation • Updated Mar 29 • 37

jdelpino-ai/mamba-2.8b-hf-Q8_0-GGUF

Updated Mar 30 • 29

jdelpino-ai/multi_verse_model-Q8_0-GGUF

Updated Mar 30 • 26 • 1

gate369/mm4.star-Q5_K_S-GGUF

Updated Mar 30 • 22

LeroyDyer/Mixtral_AI_Cyber_Dolphin-Q4_K_M-GGUF

Updated Mar 31 • 34 • 1

LeroyDyer/Mixtral_AI_Cyber_Orca-Q4_K_M-GGUF

Updated Mar 31 • 25 • 1

LeroyDyer/Mixtral_AI_CyberBrain_2.0-Q4_K_M-GGUF

Updated Mar 31 • 25

ovieyra21/BigMistral-11b-GLUED-Q8_0-GGUF

Text Generation • Updated Mar 31 • 19

LeroyDyer/Mixtral_AI_CyberBrain_2.1-Q4_K_M-GGUF

Updated Mar 31 • 21

danielus/MermaidMixtral-3x7b-Q6_K-GGUF

Updated Apr 2 • 21

danielus/MermaidMixtral-3x7b-Q8_0-GGUF

Updated Apr 2 • 20

victor/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF

Updated Apr 2 • 26

reach-vb/gemma-2b-it-Q4_K_M-GGUF

Updated Apr 3 • 36

danielus/MermaidSolar-Q8_0-GGUF

Updated Apr 3 • 20

danielus/MermaidSolar-Q5_K_M-GGUF

Updated Apr 3 • 19

danielus/MermaidSolar-Q6_K-GGUF

Updated Apr 3 • 22