Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

596

Base only

Active filters: gguf-my-lora

sai237/llama-3.1-8B-ascii-cats-lora-F32-GGUF

24.3M • Updated Feb 22 • 7 • 1

Timjak/my-1c-expert-llama-F16-GGUF

Text Generation • 41.9M • Updated Mar 26 • 23 • 1

ggml-org/LoRA-Llama-3-Instruct-abliteration-8B-F16-GGUF

88.1M • Updated Nov 1, 2024 • 8

bunnycore/LLama-3.2-1B-General-lora_model-F16-GGUF

11.3M • Updated Nov 1, 2024 • 7 • 1

bunnycore/Qwen2.5-7B-Exp2-lora_model-Q8_0-GGUF

40.4M • Updated Nov 3, 2024 • 5 • 1

Leejy0-0/Llama-3.2-3b-lora_model-F16-GGUF

24.3M • Updated Nov 4, 2024 • 1

PragmaticPete/llama3.2inst-F32-GGUF

Text Generation • 90.2M • Updated Nov 4, 2024 • 6

NikolayKozloff/Phi-3-medium-4k-instruct-sq-LORA-F16-GGUF

Text Generation • 65.5M • Updated Nov 5, 2024 • 60 • 1

NikolayKozloff/Phi-3-medium-4k-instruct-sq-LORA-F32-GGUF

Text Generation • 65.5M • Updated Nov 5, 2024 • 62 • 1

NikolayKozloff/Phi-3-medium-4k-instruct-sq-LORA-Q8_0-GGUF

Text Generation • 65.5M • Updated Nov 5, 2024 • 51 • 1

NikolayKozloff/Phi-3-mini-4k-instruct-sq-LORA-F32-GGUF

Text Generation • 29.9M • Updated Nov 5, 2024 • 61 • 1

NikolayKozloff/Phi-3-mini-4k-instruct-sq-LORA-F16-GGUF

Text Generation • 29.9M • Updated Nov 5, 2024 • 63 • 1

NikolayKozloff/Phi-3-mini-4k-instruct-sq-LORA-Q8_0-GGUF

Text Generation • 29.9M • Updated Nov 5, 2024 • 55 • 1

dimvasilk/Llama-3-Instruct-abliteration-LoRA-8B-F16-GGUF

88.1M • Updated Nov 11, 2024 • 5

Mortido/saiga_mistral_7b_lora-F16-GGUF

Text Generation • 13.6M • Updated Nov 11, 2024 • 8

Mortido/saiga_mistral_7b_lora-F32-GGUF

Text Generation • 13.6M • Updated Nov 11, 2024 • 5

Mortido/saiga_mistral_7b_lora-Q8_0-GGUF

Text Generation • 13.6M • Updated Nov 11, 2024 • 5

shafire/AgentZero-F16-GGUF

Text Generation • 54M • Updated Jun 12, 2025 • 2

shafire/AgentZero-Q8_0-GGUF

Text Generation • 54M • Updated Jun 12, 2025 • 12

JackeyLai/Qwen2.5-3B-instruct-lora-F16-GGUF

15M • Updated Nov 12, 2024 • 2

shafire/talktoai-F16-GGUF

Text Generation • 41.9M • Updated Jun 12, 2025 • 8

kenonix/koalpaca-polyglot-12.8b-bills-Q8_0-GGUF

6.55M • Updated Nov 14, 2024 • 1

Tymkolt/dragoman-F16-GGUF

Text Generation • 0.7B • Updated Nov 15, 2024 • 10

beomi/KoAlpaca-RealQA-Solar-Ko-Recovery-11B-Q8_0-GGUF

Text Generation • 62.9M • Updated Nov 25, 2024 • 10

beomi/KoAlpaca-RealQA-Solar-Ko-Recovery-11B-LoRA-ChatML-Q8_0-GGUF

62.9M • Updated Nov 26, 2024 • 7 • 1

beomi/KoAlpaca-RealQA-Solar-Ko-Recovery-11B-LoRA-ChatML-F16-GGUF

62.9M • Updated Nov 26, 2024 • 6

OMH5/241127-testdata1-F16-GGUF

27.3M • Updated Nov 28, 2024 • 1

OMH5/241127-testdata1-Q8_0-GGUF

27.3M • Updated Nov 28, 2024 • 3

eltorio/Llama-3.2-3B-appreciation-F16-GGUF

24.3M • Updated Dec 2, 2024 • 14 • 3

dysen/Llama-3-Instruct-abliteration-LoRA-8B-F16-GGUF

88.1M • Updated Nov 28, 2024 • 3