Edit Models filters

Inference Endpoints

text-generation-inference

Mixture of Experts

AutoTrain Compatible

Carbon Emissions

8-bit precision

Other with no match

4-bit precision

text-embeddings-inference

Models

2,791

Full-text search

Active filters: llama-cpp

newsletter/dolphin-2.6-mistral-7b-dpo-Q6_K-GGUF

Updated May 14 • 24 • 1

quanthunter/Hermes-2-Pro-Llama-3-8B-Q8_0-GGUF

Updated May 14 • 43

LeMoussel/Claire-7B-0.1-Q5_K_M-GGUF

Text Generation • Updated May 14 • 30

quanthunter/Hermes-2-Pro-Llama-3-8B-Q6_K-GGUF

Updated May 14 • 35

quanthunter/Hermes-2-Pro-Llama-3-8B-Q5_K_M-GGUF

Updated May 14 • 38

quanthunter/Hermes-2-Pro-Llama-3-8B-Q4_K_M-GGUF

Updated May 14 • 38

e2jhiubyiiyvw/Meta-Llama-3-8B-Instruct-Q5_K_M-GGUF

Text Generation • Updated May 14 • 171

MoMonir/granite-8b-code-instruct-GGUF

Text Generation • Updated May 14 • 64

MoMonir/codegemma-1.1-7b-it-GGUF

Text Generation • Updated May 14 • 64

NikolayKozloff/dao-9b-Q8_0-GGUF

Updated May 14 • 33 • 2

NikolayKozloff/Phi-3-Large-5.6b-Q8_0-GGUF

Text Generation • Updated May 14 • 38 • 1

NikolayKozloff/Phi3-ITA-mini-4K-instruct-Q8_0-GGUF

Updated May 14 • 28 • 1

Recaru/Llama-3-KoEn-8B-Instruct-preview-Q8_0-GGUF

Text Generation • Updated May 14 • 55

Recaru/Llama-3-KoEn-8B-Instruct-preview-Q6_K-GGUF

Text Generation • Updated May 14 • 37

Recaru/Llama-3-KoEn-8B-Instruct-preview-Q5_K_M-GGUF

Text Generation • Updated May 14 • 36

NikolayKozloff/Llama-3-8B-instruct-dansk-Q8_0-GGUF

Text Generation • Updated May 14 • 45 • 1

NikolayKozloff/Phi-3-mini-4k-instruct-dansk-Q8_0-GGUF

Updated May 14 • 23 • 1

NikolayKozloff/Llama-3-portuguese-Tom-cat-8b-instruct-Q6_K-GGUF

Text Generation • Updated May 14 • 49 • 1

NikolayKozloff/phi-3-portuguese-tom-cat-4k-instruct-Q8_0-GGUF

Text Generation • Updated May 14 • 19 • 1

NikolayKozloff/MegaBeam-Mistral-7B-300k-Q8_0-GGUF

Updated May 14 • 25 • 1

NikolayKozloff/SFR-Iterative-DPO-LLaMA-3-8B-R-Q8_0-GGUF

Updated May 14 • 44 • 3

NikolayKozloff/SFR-SFT-LLaMA-3-8B-R-Q8_0-GGUF

Updated May 14 • 41 • 3

NikolayKozloff/malaysian-llama-3-8b-instruct-16k-Q8_0-GGUF

Updated May 14 • 41 • 1

djward888/SFR-Iterative-DPO-LLaMA-3-8B-R-Q6_K-GGUF

Updated May 14 • 36

newsletter/DiscoLM_German_7b_v1-Q6_K-GGUF

Updated 22 days ago • 33

newsletter/dolphin-2.8-mistral-7b-v02-Q6_K-GGUF

Updated May 14 • 27

newsletter/Mistral-7B-Instruct-v0.2-Q6_K-GGUF

Text Generation • Updated May 14 • 44 • 1

newsletter/neural-chat-7b-v3-3-Q6_K-GGUF

Updated May 14 • 16

newsletter/rocket-3B-Q6_K-GGUF

Updated May 14 • 19

newsletter/TinyLlama-1.1B-Chat-v1.0-Q6_K-GGUF

Updated May 14 • 19