GGUF
smollm2
base-model

SmolLM2-135M-Q4_K_S

Q4_K_S GGUF of HuggingFaceTB/SmolLM2-135M, converted with llama.cpp.

This is a pretrained base model, not instruction-tuned.

Original model is Apache-2.0.

llama-cli -hf 7ven7o/SmolLM2-135M-Base-GGUF
Downloads last month
405
GGUF
Model size
0.1B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for 7ven7o/SmolLM2-135M-Base-GGUF

Quantized
(68)
this model