Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

8-bit precision

text-embeddings-inference

Misc with no match

4-bit precision

Models

5,812

Full-text search

Active filters: llama-cpp

Isaak-Carter/J.O.S.I.E.v4o-8b-stage1-beta1-Q4_k_s-gguf

Updated Jun 24 • 15 • 1

NikolayKozloff/llama3-tweety-8b-italian-Q8_0-GGUF

Updated Jun 25 • 7 • 1

NikolayKozloff/llama3-tweety-8b-italian-Q5_0-GGUF

Updated Jun 25 • 11 • 1

NikolayKozloff/llama3-tweety-8b-italian-Q4_0-GGUF

Updated Jun 25 • 38 • 1

NikolayKozloff/llama3-tweety-8b-italian-IQ4_NL-GGUF

Updated Jun 25 • 5 • 1

NikolayKozloff/tweety-dutch-7b-llama3-Q8_0-GGUF

Updated Jun 25 • 9 • 1

rdk94/Llama-3-Ko-8B-Instruct-Q8_0-GGUF

Text Generation • Updated Jun 25 • 17

Ransss/L3-Uncen-Merger-Omelette-RP-v0.1.1-8B-Q8_0-GGUF

Updated Jun 25 • 9 • 1

Daemontatox/mawremes-Q4_K_M-GGUF

Updated Jun 25 • 8

Sc0m3r/Phi-3-medium-128k-instruct-Q4_K_M-GGUF

Text Generation • Updated Jun 25 • 1

nazimali/gte-Qwen2-7B-instruct-Q6_K-GGUF

Sentence Similarity • Updated Jun 25 • 13

Raunak1/EI-Mistral-Q4_0-GGUF

Updated Jun 25 • 50 • 1

LLukas22/DeepSeek-Coder-V2-Lite-Instruct-Q4_0-GGUF

Updated Jun 25 • 105

xX-FANE-Xx/mistral-7b-eufaq-merged-Q8_0-GGUF

Updated Jun 25 • 6

Jianping746/DeepSeek-Coder-V2-Lite-Instruct-Q4_K_M-GGUF

Updated Jun 25 • 3

aimlresearch2023/gpt2-Q4_K_M-GGUF

Updated Jun 25 • 6

jkrahmann/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • Updated Jun 25 • 1

dejankocic/Mistral-7B-Instruct-v0.3-Q4_K_M-GGUF

Daemontatox/hermdpo-Q4_K_M-GGUF

Updated Jun 25 • 6

Daemontatox/mistralm-Q4_K_M-GGUF

Updated Jun 25 • 7

fenglingzmb/Yi-1.5-9B-Chat-Q4_K_M-GGUF

Updated Jun 25 • 8

Anvix/Qwen2-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jun 25

antoste/Magiq-3-Q4_K_M-GGUF

Text Generation • Updated Jun 25 • 7

antoste/Magiq-3-Q2_K-GGUF

Text Generation • Updated Jun 25 • 8

pszemraj/Mistral-7B-sarcasm-scrolls-v2-Q4_K_M-GGUF

Updated Jun 26 • 6

antoste/Minerva-3B-base-v1.0-IQ3_M-GGUF

Text Generation • Updated Jun 25 • 10

DarwinAnim8or/InstructLM-1.3B-Q4_K_M-GGUF

Updated Jun 25 • 7

Hiddengamer007/Qwen2-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jun 25 • 1

oriyaho/Meta-Llama-3-8B-Instruct-Q8_0-GGUF

Text Generation • Updated Jun 25 • 5

win10/DeepSeek-Coder-V2-Lite-Instruct-Q6_K-GGUF

Updated Jun 26 • 5