Edit Models filters

Inference Endpoints

text-generation-inference

Mixture of Experts

AutoTrain Compatible

Carbon Emissions

Other with no match

4-bit precision

text-embeddings-inference

8-bit precision

Models

3,723

Full-text search

Active filters: gguf-my-repo

Oblivionus/LLaMa-3-Stheno-v3.2-15B-Q6_K-GGUF

Updated Jun 10 • 104 • 4

MoMonir/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Jun 11 • 56 • 1

cobrakenji/granite-20b-code-instruct-Q2_K-GGUF

Text Generation • Updated Jun 10 • 14

NikolayKozloff/Llama-3-Oasis-v1-OAS-8B-Q4_0-GGUF

Text Generation • Updated Jun 10 • 90 • 1

NikolayKozloff/Llama-3-Oasis-v1-OAS-8B-Q5_0-GGUF

Text Generation • Updated Jun 10 • 18 • 1

NikolayKozloff/Llama-3-Steerpike-v1-OAS-8B-Q4_0-GGUF

Updated Jun 10 • 93 • 1

NikolayKozloff/Llama-3-Steerpike-v1-OAS-8B-Q5_0-GGUF

Updated Jun 10 • 14 • 1

jimsweb/Meta-Llama-3-8B-Q8_0-GGUF

Text Generation • Updated Jun 10 • 13

Aloshe/Sheared-LLaMA-1.3B-Q8_0-GGUF

Updated Jun 10 • 10

NikolayKozloff/SauerkrautLM-Phi-3-medium-Q5_K_M-GGUF

Updated Jun 10 • 10 • 2

NikolayKozloff/SauerkrautLM-Phi-3-medium-Q6_K-GGUF

Updated Jun 10 • 12 • 1

NikolayKozloff/SauerkrautLM-Phi-3-medium-Q4_K_M-GGUF

Updated Jun 11 • 16 • 1

mintaeng/Meta-Llama-3-8B-Q5_K_M-GGUF

Text Generation • Updated Jun 11 • 14

israellaguan/Tinyllama-moe4-Q8_0-GGUF

Updated Jun 11 • 19 • 1

NikolayKozloff/SeaPhi3-mini-Q8_0-GGUF

Updated Jun 11 • 12 • 1

NikolayKozloff/SeaPhi3-mini-Q6_K-GGUF

Updated Jun 11 • 12 • 1

NikolayKozloff/SeaPhi3-mini-Q5_K_M-GGUF

Updated Jun 11 • 14 • 1

NikolayKozloff/strela-Q4_0-GGUF

Text Generation • Updated Jun 11 • 16 • 1

NikolayKozloff/strela-Q5_0-GGUF

Text Generation • Updated Jun 11 • 16 • 1

kowlick/Codestral-22B-v0.1-Q8_0-GGUF

Updated Jun 11 • 14

eipi1-0/Qwen2-7B-Q4_K_M-GGUF

Text Generation • Updated Jun 11 • 12

SixOpen/Meta-Llama-3-8B-IQ3_M-GGUF

Text Generation • Updated Jun 11 • 13

NikolayKozloff/SauerkrautLM-Gemma-2b-Q8_0-GGUF

Updated Jun 11 • 17 • 1

SixOpen/Meta-Llama-3-8B-Instruct-IQ4_NL-GGUF

Text Generation • Updated Jun 11 • 16

NikolayKozloff/Llama-3-8B-Swedish-Norwegian-Danish-checkpoint-16000-11_6_2024-Q8_0-GGUF

Text Generation • Updated Jun 11 • 18 • 1

Ransss/YiffyEstopianMaid-13B-Q6_K-GGUF

Updated Jun 11 • 15

huangyt/module_v7-Q4_K_M-GGUF

Updated Jun 11 • 9

Jarbas/all-MiniLM-L6-v2-Q4_K_M-GGUF

Sentence Similarity • Updated Jun 11 • 19

ivar-vl/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF

Updated Jun 11 • 9

ccolicino/Mistral-7B-Instruct-v0.3-Q4_K_M-GGUF

Updated Jun 11 • 9