Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

3,982

Full-text search

Active filters: llama-cpp

Tanvir1337/BanglaLLama-3-8b-BnWiki-Instruct-IQ3_XXS-GGUF

Updated Jun 25 • 11

Tanvir1337/BanglaLLama-3-8b-BnWiki-Base-Q4_K_M-GGUF

Updated Jun 25 • 13

Tanvir1337/BanglaLLama-3-8b-BnWiki-Base-IQ4_XS-GGUF

Updated Jun 25 • 15

Hiddengamer007/Qwen2-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jun 25 • 10

oriyaho/Meta-Llama-3-8B-Instruct-Q8_0-GGUF

Text Generation • Updated Jun 25 • 22

Daemontatox/llamared8b64-Q4_K_M-GGUF

Updated Jun 25 • 13

win10/DeepSeek-Coder-V2-Lite-Instruct-Q6_K-GGUF

Updated Jun 26 • 40

win10/DeepSeek-Coder-V2-Lite-Instruct-Q8_0-GGUF

Updated Jun 26 • 34

win10/Breeze-13B-32k-Instruct-v1_0-Q8_0-GGUF

Updated Jun 29 • 13

cptnemo-pata/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jun 26 • 12

icycodes/deepseek-coder-6.7b-base-Q8_0-GGUF

Updated Jun 26 • 2.34k

Klevin/EM-Mistral-7b-v-0.3-Q4_K_M-GGUF

Updated Jun 26 • 22 • 1

Klevin/EMO-Ai-7b-Q2_K-GGUF

Updated Jun 26 • 11 • 1

Klevin/EMO-Ai-7b-Q8_0-GGUF

Updated Jun 26 • 7

Klevin/EMO-Ai-7b-Q4_0-GGUF

Updated Jun 26 • 28 • 1

Fulcrum-AI/Ryze-Q4_K_M-GGUF

Updated Jun 26 • 12

phillip888/Llama3-TAIDE-LX-8B-Chat-Alpha1-Q4_K_M-GGUF

Updated Jun 26 • 23

phillip888/Llama3-TAIDE-LX-8B-Chat-Alpha1-Q8_0-GGUF

Updated Jun 26 • 23

Tanvir1337/BanglaLLama-3-8b-BnWiki-Base-IQ3_XXS-GGUF

Updated Jun 26 • 18

Tanvir1337/Mistral-v0.2-Nexus-Internal-Knowledge-Map-7B-Q5_K_M-GGUF

Text Generation • Updated Jun 26 • 10

Tanvir1337/Mistral-v0.2-Nexus-Internal-Knowledge-Map-7B-Q4_K_M-GGUF

Text Generation • Updated Jun 26 • 10

Tanvir1337/Mistral-v0.2-Nexus-Internal-Knowledge-Map-7B-Q6_K-GGUF

Text Generation • Updated Jun 26 • 11

Tanvir1337/Mistral-v0.2-Nexus-Internal-Knowledge-Map-7B-Q4_0-GGUF

Text Generation • Updated Jun 26 • 65

Tanvir1337/Mistral-v0.2-Nexus-Internal-Knowledge-Map-7B-IQ4_XS-GGUF

Text Generation • Updated Jun 26 • 8

Tanvir1337/Mistral-v0.2-Nexus-Internal-Knowledge-Map-7B-IQ3_XXS-GGUF

Text Generation • Updated Jun 26 • 8

icycodes/deepseek-coder-1.3b-base-Q8_0-GGUF

Updated Jun 26 • 415

Fulcrum-AI/Ryze-Q8_0-GGUF

Updated Jun 26 • 13

jerrykim9981/no-robots-y34b-lora-Q8_0-GGUF

Updated Jun 26 • 9

nalf3in2/Llama-3-Instruct-8B-SPPO-Iter3-Q5_K_S-GGUF

Text Generation • Updated Jun 26 • 11

Trisert/Llama-3-Instruct-8B-SPPO-Iter3-Q5_K_S-GGUF

Text Generation • Updated Jun 26 • 14