Edit Models filters

Inference Endpoints

text-generation-inference

Mixture of Experts

AutoTrain Compatible

Carbon Emissions

8-bit precision

Other with no match

4-bit precision

text-embeddings-inference

Models

2,837

Full-text search

Active filters: llama-cpp

Recaru/Llama-3-KoEn-8B-Instruct-preview-Q8_0-GGUF

Text Generation • Updated May 14 • 55

Recaru/Llama-3-KoEn-8B-Instruct-preview-Q6_K-GGUF

Text Generation • Updated May 14 • 36

Recaru/Llama-3-KoEn-8B-Instruct-preview-Q5_K_M-GGUF

Text Generation • Updated May 14 • 36

NikolayKozloff/Llama-3-8B-instruct-dansk-Q8_0-GGUF

Text Generation • Updated May 14 • 44 • 1

NikolayKozloff/Phi-3-mini-4k-instruct-dansk-Q8_0-GGUF

Updated May 14 • 23 • 1

NikolayKozloff/Llama-3-portuguese-Tom-cat-8b-instruct-Q6_K-GGUF

Text Generation • Updated May 14 • 48 • 1

NikolayKozloff/phi-3-portuguese-tom-cat-4k-instruct-Q8_0-GGUF

Text Generation • Updated May 14 • 19 • 1

NikolayKozloff/MegaBeam-Mistral-7B-300k-Q8_0-GGUF

Updated May 14 • 25 • 1

NikolayKozloff/SFR-Iterative-DPO-LLaMA-3-8B-R-Q8_0-GGUF

Updated May 14 • 42 • 3

NikolayKozloff/SFR-SFT-LLaMA-3-8B-R-Q8_0-GGUF

Updated May 14 • 33 • 3

NikolayKozloff/malaysian-llama-3-8b-instruct-16k-Q8_0-GGUF

Updated May 14 • 39 • 1

djward888/SFR-Iterative-DPO-LLaMA-3-8B-R-Q6_K-GGUF

Updated May 14 • 36

newsletter/DiscoLM_German_7b_v1-Q6_K-GGUF

Updated 24 days ago • 33

newsletter/dolphin-2.8-mistral-7b-v02-Q6_K-GGUF

Updated May 14 • 30

newsletter/Mistral-7B-Instruct-v0.2-Q6_K-GGUF

Text Generation • Updated May 14 • 41 • 1

newsletter/neural-chat-7b-v3-3-Q6_K-GGUF

Updated May 14 • 16

newsletter/rocket-3B-Q6_K-GGUF

Updated May 14 • 19

newsletter/TinyLlama-1.1B-Chat-v1.0-Q6_K-GGUF

Updated May 14 • 19

newsletter/openchat-3.5-0106-Q6_K-GGUF

Text Generation • Updated May 14 • 18

newsletter/Starling-LM-7B-beta-Q6_K-GGUF

Updated May 14 • 22

seawolf2357/Meta-Llama-3-70B-Instruct-Q4_K_M-GGUF

Text Generation • Updated May 14 • 42 • 2

jeiku/Puppy_Purpose_0.69-Q4_K_M-GGUF

Updated May 14 • 36

CheeseCoder/pythia-12b-deduped-Q4_K_M-GGUF

Updated May 15 • 27

Recaru/KULLM3-Q4_K_S-GGUF

Updated May 15 • 22

Sagicc/SFR-Iterative-DPO-LLaMA-3-8B-R-Q4_K_M-GGUF

Updated May 15 • 7.82k

QiyuWu/DPO-Internlm2-1_8B-Q4_K_M-GGUF

Updated May 15 • 29 • 1

cleatherbury/TinyDolphin-2.8.1-1.1b-Q4_K_M-GGUF

Updated May 15 • 23

newsletter/Wiedervereinigung-7b-dpo-Q6_K-GGUF

Updated 24 days ago • 36

newsletter/Wiedervereinigung-7b-dpo-laser-Q6_K-GGUF

Updated 24 days ago • 49

krupakar-reddy/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • Updated May 15 • 32