cevher-406m-v16_2 — GGUF

SmolLM2 (Llama) mimarisiyle sıfırdan eğitilmiş modelin GGUF sürümleri. Eğitim token sayısı: 2.359 B · hidden 1792 · 34 katman.

Dosya Boyut
cevher-406m-v16_2-BF16.gguf 2889 MB
cevher-406m-v16_2-Q8_0.gguf 1536 MB
cevher-406m-v16_2-Q5_K_M.gguf 1035 MB
cevher-406m-v16_2-Q4_K_M.gguf 893 MB

llama.cpp

llama-cli -m cevher-406m-v16_2-Q4_K_M.gguf -p "Merhaba" -cnv

Ollama

ollama create cevher-406m-v16_2 -f Modelfile
ollama run cevher-406m-v16_2

LM Studio

Dosyayı ~/.cache/lm-studio/models/bcckfdn/cevher2-test-4-GGUF/ altına koyun ya da uygulama içinden arayın.

Downloads last month
195
GGUF
Model size
2B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

4-bit

5-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for bcckfdn/cevher2-test-4-GGUF

Quantized
(1)
this model