mudler/Minerva-3B-base-v1.0-Q8_0-GGUF
Text Generation
•
Updated
•
21
Quants
Models quantized for LocalAI and llama.cpp
-
-
mudler/Minerva-3B-Instruct-v1.0-Q8_0-GGUF
Text Generation • Updated • 21 -
mudler/Minerva-3B-base-v1.0-Q6_K-GGUF
Text Generation • Updated • 19 -
mudler/Minerva-3B-Instruct-v1.0-Q6_K-GGUF
Text Generation • Updated • 23 -
mudler/Minerva-3B-Instruct-v1.0-Q4_0-GGUF
Text Generation • Updated • 41 -
mudler/Minerva-3B-base-v1.0-Q5_0-GGUF
Text Generation • Updated • 19 -
mudler/prem-1B-chat-Q8_0-GGUF
Text Generation • Updated • 19 -
mudler/prem-1B-chat-Q6_K-GGUF
Text Generation • Updated • 25 -
mudler/Minerva-3B-base-v1.0-Q2_K-GGUF
Text Generation • Updated • 21 -
mudler/Minerva-3B-base-v1.0-Q5_K_M-GGUF
Text Generation • Updated • 17 -
mudler/Minerva-3B-Instruct-v1.0-Q4_K_M-GGUF
Text Generation • Updated • 23 -
mudler/prem-1B-chat-Q5_0-GGUF
Text Generation • Updated • 19 • 1 -
mudler/Minerva-1B-base-v1.0-Q5_K_M-GGUF
Text Generation • Updated • 23 -
mudler/Minerva-1B-base-v1.0-Q4_0-GGUF
Text Generation • Updated • 27 -
mudler/prem-1B-chat-Q4_0-GGUF
Text Generation • Updated • 39 -
mudler/Minerva-350M-base-v1.0-Q8_0-GGUF
Text Generation • Updated • 23 -
mudler/Minerva-350M-base-v1.0-Q5_0-GGUF
Text Generation • Updated • 21 -
mudler/Minerva-350M-base-v1.0-Q4_0-GGUF
Text Generation • Updated • 28 -
mudler/Minerva-3B-base-v1.0-Q4_K_M-GGUF
Text Generation • Updated • 19 -
mudler/Llama-3-8b-ita-ties2-Q4_K_M-GGUF
Updated • 47 • 1 -
mudler/L3-8B-Stheno-v3.1-Q4_K_M-GGUF
Updated • 145 • 2 -
mudler/llama-3-Stheno-Mahou-8B-Q4_K_M-GGUF
Updated • 578 • 2