Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

4-bit precision

8-bit precision

Models

5,034

Full-text search

Active filters: gguf-my-repo

ywms666/gpt-neox-20b-fiction-novel-generation-Q4_K_M-GGUF

Text Generation • Updated 6 days ago • 28

hellork/Configurable-Llama-3.1-8B-Instruct-IQ4_NL-GGUF

Updated 6 days ago • 18

ijohn07/Chocolatine-14B-Instruct-4k-DPO-Q2_K-GGUF

Text Generation • Updated 6 days ago • 13

ijohn07/internlm2_5-7b-chat-Q2_K-GGUF

Text Generation • Updated 6 days ago • 13

DrNicefellow/Llama3.1-8b-NiceFellow-Chat-Q8_0-GGUF

Updated 6 days ago • 18

DrNicefellow/Llama3.1-8b-NiceFellow-Chat-Tess-v1.5-Q8_0-GGUF

Updated 6 days ago • 14

Ffftdtd5dtft/gemma-2-2b-it-Q2_K-GGUF

Text Generation • Updated 6 days ago • 7

unclemusclez/SmolLM-135M-Instruct-DEVINator-v0.2-Q8_0-GGUF

Sentence Similarity • Updated 6 days ago • 8

Deepcodr/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • Updated 6 days ago • 8

pingzhou/Meta-Llama-3.1-8B-Instruct-Q3_K_M-GGUF

Text Generation • Updated 6 days ago • 3

pingzhou/Meta-Llama-3.1-8B-Instruct-Q2_K-GGUF

Text Generation • Updated 6 days ago • 3

steinzer-narayan/caudwell-9b-v0-Q6_K-GGUF

Updated 6 days ago • 16

blogcncom/bge-m3-Q4_0-GGUF

Sentence Similarity • Updated 6 days ago • 19

woofwolfy/Llama-3.1-8B-Ultra-Instruct-Q4_K_M-GGUF

Updated 6 days ago • 62

DrNicefellow/Llama3.1-8b-Nicefellow-RewardModel-Q8_0-GGUF

Updated 6 days ago • 19

Ffftdtd5dtft/sarvam-2b-v0.5-Q2_K-GGUF

Updated 6 days ago • 6

Ffftdtd5dtft/WizardLM-13B-Uncensored-Q2_K-GGUF

Updated 6 days ago • 53

Ffftdtd5dtft/WizardLM-7B-Uncensored-Q2_K-GGUF

Updated 6 days ago • 49

Ffftdtd5dtft/Qwen2-Math-72B-Instruct-Q2_K-GGUF

Text Generation • Updated 6 days ago • 19

Ffftdtd5dtft/Qwen2-Math-7B-Instruct-Q2_K-GGUF

Text Generation • Updated 5 days ago • 41

Vencibo/BgGPT-7B-Instruct-v0.2-Q5_K_M-GGUF

Text Generation • Updated 5 days ago • 9

mashima/gemma-2-9b-it-Q8_0-GGUF

Text Generation • Updated 5 days ago • 16

djuna/Gemma-2-gemmama-9b-Q5_K_M-GGUF

Updated 5 days ago • 30

mashima/gemma-2-9b-it-Q6_K-GGUF

Text Generation • Updated 5 days ago • 17

Triangle104/Pantheon-RP-1.6-12b-Nemo-Q8_0-GGUF

Updated 5 days ago • 16

Triangle104/Replete-LLM-V2-Llama-3.1-8b-Q4_0-GGUF

Updated 5 days ago • 29

Triangle104/Replete-LLM-V2-Llama-3.1-8b-Q5_K_M-GGUF

Updated 5 days ago • 39

Triangle104/Replete-LLM-V2-Llama-3.1-8b-Q6_K-GGUF

Updated 5 days ago • 18

zyj2003lj/nomic-embed-text-v1.5-Q4_K_M-GGUF

Sentence Similarity • Updated 5 days ago • 7

Triangle104/Replete-LLM-V2-Llama-3.1-8b-Q8_0-GGUF

Updated 5 days ago • 10