Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

AutoTrain Compatible

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

17,539

Full-text search

Active filters: llama-cpp

openfree/Gemma-3-R1984-12B-Q8_0-GGUF

Image-Text-to-Text • Updated 7 days ago • 2.03k • 58

openfree/Gemma-3-R1984-27B-Q8_0-GGUF

Image-Text-to-Text • Updated 7 days ago • 1.79k • 57

openfree/QwQ-R1984-32B-Q4_K_M-GGUF

Updated 5 days ago • 360 • 57

openfree/Gemma-3-R1984-12B-Q6_K-GGUF

Image-Text-to-Text • Updated 7 days ago • 1.87k • 56

openfree/QwQ-32B-Q8_0-GGUF

Text Generation • Updated 7 days ago • 1.92k • 55

openfree/Qwen2.5-VL-32B-Instruct-Q4_K_M-GGUF

Image-Text-to-Text • Updated 6 days ago • 2.14k • 55

openfree/Gemma-3-R1984-27B-Q4_K_M-GGUF

Image-Text-to-Text • Updated 7 days ago • 1.63k • 54

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q8_0-GGUF

Image-Text-to-Text • Updated 7 days ago • 2.23k • 54

openfree/Qwen2.5-VL-32B-Instruct-Q8_0-GGUF

Image-Text-to-Text • Updated 7 days ago • 1.67k • 54

openfree/QwQ-R1984-32B-Q8_0-GGUF

Updated 5 days ago • 226 • 54

openfree/Gemma-3-R1984-27B-Q6_K-GGUF

Image-Text-to-Text • Updated 7 days ago • 1.56k • 53

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q6_K-GGUF

Image-Text-to-Text • Updated 7 days ago • 5.32k • 52

openfree/Llama-3_3-Nemotron-Super-49B-v1-Q6_K-GGUF

Text Generation • Updated 7 days ago • 1.76k • 52

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M-GGUF

Image-Text-to-Text • Updated 7 days ago • 1.7k • 52

openfree/Llama-3_3-Nemotron-Super-49B-v1-Q4_K_M-GGUF

Text Generation • Updated 7 days ago • 2.22k • 52

openfree/QwQ-32B-Q4_K_M-GGUF

Text Generation • Updated 6 days ago • 2.14k • 52

isaiahbjork/orpheus-3b-0.1-ft-Q4_K_M-GGUF

Text-to-Speech • Updated 17 days ago • 9.41k • 40

NikolayKozloff/Llama-PLLuM-8B-instruct-Q8_0-GGUF

Updated Feb 24 • 113 • 4

NikolayKozloff/YandexGPT-5-Lite-8B-instruct-Q8_0-GGUF

Updated 5 days ago • 93 • 3

KimChen/gemma-2-27b-it-Q8_0-GGUF

Text Generation • Updated Jun 30, 2024 • 471 • 2

KimChen/bge-m3-GGUF

Sentence Similarity • Updated Aug 29, 2024 • 458 • 4

lukasfast/Teuken-7B-instruct-research-v0.4-Q6_K-GGUF

Text Generation • Updated Jan 22 • 112 • 2

NikolayKozloff/Selene-1-Mini-Llama-3.1-8B-Q6_K-GGUF

Text Generation • Updated Jan 29 • 175 • 3

Karsh-CAI/Mistral-Small-24B-Instruct-2501-Q8_0-GGUF

Updated Jan 30 • 35 • 2

NikolayKozloff/DeepSeek-R1-ReDistill-Qwen-7B-v1.1-Q8_0-GGUF

Text Generation • Updated Jan 30 • 80 • 2

NikolayKozloff/DeepSeek-R1-Distill-Qwen-1.5B-Multilingual-Q8_0-GGUF

Updated Jan 31 • 275 • 2

smirki/UIGEN-T1.1-Qwen-7B-Q4_K_M-GGUF

Updated Feb 18 • 38 • 2

NikolayKozloff/PLLuM-12B-instruct-Q5_K_M-GGUF

Updated Feb 24 • 44 • 2

paultimothymooney/gemma-3-27b-it-Q4_K_M-GGUF

Image-Text-to-Text • Updated 24 days ago • 280 • 2

NovNovikov/gemma-3-27b-it-abliterated-Q4_K_M-GGUF

Image-Text-to-Text • Updated 19 days ago • 546 • 2