mudler/Minerva-3B-base-v1.0-Q8_0-GGUF
Text Generation
•
Updated
•
38
Quants
Models quantized for LocalAI and llama.cpp
-
-
mudler/Minerva-3B-Instruct-v1.0-Q8_0-GGUF
Text Generation • Updated • 33 -
mudler/Minerva-3B-base-v1.0-Q6_K-GGUF
Text Generation • Updated • 30 -
mudler/Minerva-3B-Instruct-v1.0-Q6_K-GGUF
Text Generation • Updated • 25 -
mudler/Minerva-3B-Instruct-v1.0-Q4_0-GGUF
Text Generation • Updated • 45 -
mudler/Minerva-3B-base-v1.0-Q5_0-GGUF
Text Generation • Updated • 28 -
mudler/prem-1B-chat-Q8_0-GGUF
Text Generation • Updated • 26 -
mudler/prem-1B-chat-Q6_K-GGUF
Text Generation • Updated • 26 -
mudler/Minerva-3B-base-v1.0-Q2_K-GGUF
Text Generation • Updated • 30 -
mudler/Minerva-3B-base-v1.0-Q5_K_M-GGUF
Text Generation • Updated • 27 -
mudler/Minerva-3B-Instruct-v1.0-Q4_K_M-GGUF
Text Generation • Updated • 25 -
mudler/prem-1B-chat-Q5_0-GGUF
Text Generation • Updated • 27 • 1 -
mudler/Minerva-1B-base-v1.0-Q5_K_M-GGUF
Text Generation • Updated • 28 -
mudler/Minerva-1B-base-v1.0-Q4_0-GGUF
Text Generation • Updated • 29 -
mudler/prem-1B-chat-Q4_0-GGUF
Text Generation • Updated • 41 -
mudler/Minerva-350M-base-v1.0-Q8_0-GGUF
Text Generation • Updated • 33 -
mudler/Minerva-350M-base-v1.0-Q5_0-GGUF
Text Generation • Updated • 25 -
mudler/Minerva-350M-base-v1.0-Q4_0-GGUF
Text Generation • Updated • 33 -
mudler/Minerva-3B-base-v1.0-Q4_K_M-GGUF
Text Generation • Updated • 30 -
mudler/Llama-3-8b-ita-ties2-Q4_K_M-GGUF
Updated • 67 • 1 -
mudler/L3-8B-Stheno-v3.1-Q4_K_M-GGUF
Updated • 167 • 1 -
mudler/llama-3-Stheno-Mahou-8B-Q4_K_M-GGUF
Updated • 546 • 1