Edit Models filters

Inference Endpoints

text-generation-inference

Mixture of Experts

AutoTrain Compatible

8-bit precision

Carbon Emissions

Other with no match

4-bit precision

Models

2,191

Full-text search

Active filters: llama-cpp

NikolayKozloff/internlm2-math-plus-20b-Q4_0-GGUF

Text Generation • Updated 7 days ago • 7 • 1

NikolayKozloff/Llama-3-Instruct-8B-SimPO-Q5_0-GGUF

Updated 7 days ago • 22 • 1

NikolayKozloff/Alpha-Ophiuchi-mini-128k-v0.1-Q4_0-GGUF

Updated 5 days ago • 180 • 1

NikolayKozloff/Alpha-Ophiuchi-mini-128k-v0.1-Q5_0-GGUF

Updated 5 days ago • 431 • 1

AIRider/Ko-Llama3-Luxia-8B-Q4_K_M-GGUF

Text Generation • Updated 4 days ago • 132 • 1

YorkieOH10/AlchemistCoder-DS-6.7B-Q8_0-GGUF

Updated 4 days ago • 11 • 1

NikolayKozloff/suzume-llama-3-8B-multilingual-orpo-borda-half-Q6_K-GGUF

Updated 4 days ago • 18 • 1

NikolayKozloff/suzume-llama-3-8B-multilingual-orpo-borda-half-Q5_K_M-GGUF

Updated 4 days ago • 19 • 1

NikolayKozloff/suzume-llama-3-8B-multilingual-orpo-borda-full-Q8_0-GGUF

Updated 4 days ago • 21 • 1

NikolayKozloff/suzume-llama-3-8B-multilingual-orpo-borda-top75-Q8_0-GGUF

Updated 4 days ago • 74 • 1

NikolayKozloff/AlchemistCoder-DS-6.7B-Q4_0-GGUF

Updated 4 days ago • 374 • 1

NikolayKozloff/AlchemistCoder-DS-6.7B-Q5_0-GGUF

Updated 4 days ago • 5 • 1

NikolayKozloff/Llama-3-11.5B-V2-Q4_0-GGUF

Updated 3 days ago • 21 • 1

NikolayKozloff/Llama-3-11.5B-V2-Q5_0-GGUF

Updated 3 days ago • 53 • 1

NikolayKozloff/Llama-3-11.5B-Instruct-V2-Q5_0-GGUF

Updated 3 days ago • 22 • 1

NikolayKozloff/Llama-3-Ultron-Q8_0-GGUF

Updated 3 days ago • 23 • 1

NikolayKozloff/tweety-7b-armenian-v24a-Q8_0-GGUF

Updated 2 days ago • 10 • 1

NikolayKozloff/Nanbeige2-16B-Chat-Q4_K_M-GGUF

Text Generation • Updated 2 days ago • 58 • 1

NikolayKozloff/Nanbeige2-16B-Chat-Q4_K_S-GGUF

Text Generation • Updated 2 days ago • 10 • 1

NikolayKozloff/Nanbeige2-16B-Chat-Q4_0-GGUF

Text Generation • Updated 2 days ago • 4 • 1

NikolayKozloff/Nanbeige2-16B-Chat-Q5_K_S-GGUF

Text Generation • Updated 2 days ago • 19 • 1

NikolayKozloff/Nanbeige2-16B-Chat-Q5_0-GGUF

Text Generation • Updated 2 days ago • 7 • 1

Svngoku/African-ultrachat-alpaca-Q5_K_M-GGUF

Updated about 19 hours ago • 15 • 1

NikolayKozloff/Wiedervereinigung-7b-dpo-laser-Q8_0-GGUF

Updated 1 day ago • 51 • 1

NikolayKozloff/Awanllm-Llama-3-8B-Cumulus-v1.0-Q4_0-GGUF

Updated 1 day ago • 11 • 1

NikolayKozloff/Awanllm-Llama-3-8B-Cumulus-v1.0-Q5_0-GGUF

Updated 1 day ago • 9 • 1

AlirezaF138/shotor-GGUF

Text Generation • Updated 1 day ago • 10 • 1

AlirezaF138/paya-GGUF

Text Generation • Updated 1 day ago • 11 • 1

NikolayKozloff/Llama-3-8B-Swedish-Norwegian-Danish-checkpoint-8200-29_5_2024-Q8_0-GGUF

Text Generation • Updated about 17 hours ago • 1

arkii/chatglm2-6b-ggml

Updated Jul 26, 2023 • 6