metadata
library_name: transformers
license: apache-2.0
quantized_by: stillerman
tags:
- llamafile
- gguf
language:
- en
datasets:
- HuggingFaceTB/smollm-corpus
SmolLM-135M-Instruct - llamafile
This repo contains .gguf
and .llamafile
files for SmolLM-135M-Instruct. Llamafiles are single-file executables (called a "llamafile") that run locally on most computers, with no installation.
Use it in 3 lines!
wget https://huggingface.co/stillerman/SmolLM-360M-Instruct-Llamafile/blob/main/SmolLM-135M-Instruct-F16.llamafile
chmod a+x SmolLM-135M-Instruct-F16.llamafile
./SmolLM-135M-Instruct-F16.llamafile
Thank you to
- Huggingface for SmolLM model family
- Mozilla for Llamafile
- llama.cpp
- Justine Tunney and Compilade for help