xriminact/SmolLM-1.7B-Instruct-GGUF

Model Sources

https://huggingface.co/HuggingFaceTB/SmolLM-1.7B-Instruct

Uses

v v small model for running on edge with :fire: TTFT & Throughput

Direct Use

Use llama.cpp to inference the model